-- Logs begin at Mon 2022-09-19 09:44:51 UTC, end at Mon 2022-09-19 11:03:59 UTC. -- Sep 19 10:27:07.791164 dv-cinder-858275-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 10:27:07.801862 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 10:27:07 2022] *** Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: nodename: dv-cinder-858275-1-iscsi Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: machine: x86_64 Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: clock source: unix Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: pcre jit disabled Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: detected number of CPU cores: 4 Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: current working directory: / Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: detected binary path: /usr/bin/uwsgi-core Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: your processes number limit is 47680 Sep 19 10:27:07.803860 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: your memory page size is 4096 bytes Sep 19 10:27:07.804589 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: detected max file descriptor number: 2048 Sep 19 10:27:07.804589 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: lock engine: pthread robust mutexes Sep 19 10:27:07.804589 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: thunder lock: enabled Sep 19 10:27:07.804589 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 10:27:07.804589 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 10:27:07.845662 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: Python main interpreter initialized at 0x5642ab7829c0 Sep 19 10:27:07.845662 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: python threads support enabled Sep 19 10:27:07.845662 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: your server socket listen backlog is limited to 100 connections Sep 19 10:27:07.845662 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: your mercy for graceful operations on workers is 90 seconds Sep 19 10:27:07.845999 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 10:27:07.846089 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: *** Operational MODE: preforking *** Sep 19 10:27:07.846339 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: *** uWSGI is running in multiple interpreter mode *** Sep 19 10:27:07.846339 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: spawned uWSGI master process (pid: 106013) Sep 19 10:27:07.846534 dv-cinder-858275-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 10:27:07.847534 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: spawned uWSGI worker 1 (pid: 106014, cores: 1) Sep 19 10:27:07.847534 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: spawned uWSGI worker 2 (pid: 106015, cores: 1) Sep 19 10:27:07.847711 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 10:27:08.496823 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 10:27:08.503367 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 10:27:09.569798 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:27:09.569798 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: from cryptography.utils import int_from_bytes Sep 19 10:27:09.570393 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:27:09.570393 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: from cryptography.utils import int_from_bytes Sep 19 10:27:09.573591 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:27:09.573591 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: from cryptography.utils import int_from_bytes Sep 19 10:27:09.574013 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:27:09.574013 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: from cryptography.utils import int_from_bytes Sep 19 10:27:12.036899 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:27:12.037501 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:27:12.037699 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:27:12.038072 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:27:12.038215 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:27:12.038585 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:27:12.038658 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:27:12.038726 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.038887 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:27:12.039003 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.039240 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:27:12.039339 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.039497 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:27:12.039667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.040420 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.040516 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.040749 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.040837 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041097 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041189 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041414 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041504 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041736 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041829 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.041996 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042093 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042311 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042409 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042636 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858275-1-iscsi {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042732 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.042959 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043067 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043233 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043374 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043532 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043618 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043856 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858275-1-iscsi {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.043951 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044156 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044241 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044473 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044559 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044775 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.044870 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.045118 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.045364 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.045474 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046531 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046636 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046714 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046786 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046786 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046913 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.046999 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047066 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047138 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047204 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047442 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047611 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047748 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047884 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.047968 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048106 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048239 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048340 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048547 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048635 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.048928 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049023 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858275-1-iscsi {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049272 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049370 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049583 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049677 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049893 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.049981 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858275-1-iscsi {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.050280 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.050370 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.050595 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.050705 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.050903 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051001 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051223 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051320 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051550 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051644 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051856 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.051943 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052181 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052277 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052500 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052595 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052801 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.052896 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053153 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053255 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053457 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053548 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053766 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.053853 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054074 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054165 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054375 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054460 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054683 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054769 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.054988 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055076 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055272 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055367 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055582 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055679 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055905 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.055993 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056154 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056246 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056467 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056593 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056783 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.056882 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057019 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057133 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057365 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057456 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057660 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057745 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057911 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.057997 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058236 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058336 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058556 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058649 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058859 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.058956 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059164 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059247 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059467 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059770 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.059865 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060072 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060163 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060377 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060461 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060682 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060775 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.060990 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061098 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061323 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061407 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061640 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061737 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.061963 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062048 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062264 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062347 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062569 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062663 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062904 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.062989 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063202 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063285 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063513 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063610 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063826 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.063912 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064145 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064231 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064453 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064544 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064758 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.064915 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065076 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065214 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065378 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065515 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065691 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.065997 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066147 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066289 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066424 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066577 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066844 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.066988 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067122 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067278 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067414 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067549 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067692 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067843 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.067992 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068127 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068261 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068394 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068567 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068717 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.068865 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069000 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069193 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069332 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069481 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069616 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069750 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.069891 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070051 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070188 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070355 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070500 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070641 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070775 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.070983 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071131 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071275 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071409 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071589 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071730 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.071896 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072036 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072179 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072320 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072486 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072632 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072792 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.072945 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073113 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073275 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073415 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073557 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073716 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.073802 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074014 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074111 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074330 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074427 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074631 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074725 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.074933 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075029 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075250 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075336 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075550 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075636 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075851 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.075948 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076163 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076250 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076462 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076549 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076764 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.076851 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077105 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077197 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077412 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077511 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077713 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.077800 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078015 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078104 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078321 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078418 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078623 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078716 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.078923 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079009 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079223 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079325 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079524 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079625 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079818 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.079905 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080119 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080214 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080423 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080510 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080723 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.080819 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081025 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081129 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081355 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081443 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081666 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081751 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.081974 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.082064 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.082281 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.082369 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.082601 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:27:12.082689 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.082934 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083030 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083263 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083357 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083594 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083801 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083893 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.083972 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084211 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084297 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084525 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084625 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084850 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.084936 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085185 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085276 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085498 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085599 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085811 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.085900 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.086121 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.086206 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.086935 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087150 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087260 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087509 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087605 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.087918 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088148 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088244 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088467 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088555 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088784 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.088873 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089146 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089238 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089462 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089548 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089785 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.089885 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090099 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090195 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090425 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090512 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090741 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.090838 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091072 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091167 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091398 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091485 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091716 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.091813 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092029 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092125 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092339 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092433 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092649 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092746 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.092962 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093106 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093304 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093394 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093619 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.093938 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094030 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094252 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094340 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094572 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094659 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094883 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.094986 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095197 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095302 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095506 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095603 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095817 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.095903 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096127 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096222 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096438 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096526 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096753 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.096842 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097090 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097196 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097414 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097504 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097728 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.097824 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098045 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098145 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098355 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098443 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098665 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098761 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.098980 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099079 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099282 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099373 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099585 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099673 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099891 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.099987 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100195 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100281 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100496 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100582 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100805 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.100900 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101138 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101241 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101460 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101549 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101785 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.101873 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.102142 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.102975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103063 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103287 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103383 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103601 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103744 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.103907 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104042 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104216 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104304 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104526 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104613 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.104924 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105164 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105269 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105476 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105565 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105780 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.105880 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106104 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106192 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106408 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106495 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106712 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.106808 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107028 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107128 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107337 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107433 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107646 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107809 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.107958 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108045 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108268 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108355 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108581 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108677 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108894 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.108980 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109230 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109334 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109545 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109632 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109859 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.109953 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110198 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110288 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110529 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110625 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110839 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.110926 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111167 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111262 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111471 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111558 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111782 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.111870 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112089 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112182 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112393 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112482 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112696 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.112783 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113000 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113147 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113329 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113425 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113633 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113729 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.113936 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114072 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114237 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114326 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114540 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114628 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114842 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.114942 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115148 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115243 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115447 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115534 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115763 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.115884 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116054 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116155 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116363 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116479 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116664 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.116767 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117002 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117129 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117331 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117427 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117671 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.117815 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118015 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118105 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118328 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118416 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118643 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118782 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.118956 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119044 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119266 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119355 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119577 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119664 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119884 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.119970 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120196 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120302 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120502 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120590 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120821 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.120907 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121152 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121258 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121473 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121567 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121779 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.121866 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122098 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122242 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122404 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122493 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122717 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.122804 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123022 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123122 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123341 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123433 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123676 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123763 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.123998 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124094 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124311 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124408 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124624 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124718 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.124933 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125022 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125273 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125361 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125582 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125677 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125893 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.125980 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126206 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126300 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126516 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126602 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126833 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.126921 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127226 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127456 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127542 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127763 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.127850 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128169 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128387 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128474 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128701 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.128789 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129006 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129122 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129349 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129455 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129676 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129763 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.129988 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130077 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130305 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130400 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130614 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130700 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.130925 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131013 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131235 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131332 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131540 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131627 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131846 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.131932 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132150 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132245 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132460 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132547 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132768 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.132854 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133110 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133205 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133427 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133515 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133737 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.133824 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134045 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134133 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134352 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134440 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134658 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134746 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.134962 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135049 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135272 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135407 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135579 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135666 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135901 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.135997 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136215 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136303 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136520 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136682 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136828 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.136915 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.137168 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.137257 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.137478 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.137577 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138152 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138280 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138396 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138511 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138601 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138691 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138691 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138845 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.138986 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139288 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139389 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139606 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139694 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.139923 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140010 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140230 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140318 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140546 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140640 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140856 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.140943 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141190 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141283 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141503 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141602 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141813 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.141899 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142124 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142213 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142436 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142530 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142743 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.142830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143051 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143138 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143362 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143448 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143675 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143771 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.143982 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144076 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144295 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144444 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144602 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144707 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144906 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.144996 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.145239 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.145343 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.145549 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.145650 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.145861 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.146116 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.146204 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.146453 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.146732 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.146830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147068 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147156 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147387 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147475 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147709 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.147805 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148041 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148130 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148455 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148668 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.148755 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.149510 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.149620 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.149826 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.149914 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150135 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150223 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150441 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150537 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.150832 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.151050 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.151211 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.151356 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.151446 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.151937 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152024 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152244 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152330 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152548 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152640 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152852 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.152944 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153175 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153277 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153482 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153570 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153787 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.153874 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154089 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154182 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154401 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154541 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154704 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.154794 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155017 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155114 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155322 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155408 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155626 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155723 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.155927 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156025 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156229 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156316 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156533 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156621 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156838 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.156935 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157203 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157294 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157513 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157611 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157856 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.157962 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158160 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158246 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158467 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158556 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158791 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.158880 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159097 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159192 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159408 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159495 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159711 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.159806 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160015 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160102 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160319 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160414 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160621 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160716 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.160928 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161014 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161257 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161346 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161568 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161658 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161876 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.161971 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162176 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162273 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162484 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162572 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162785 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.162870 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163094 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163190 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163407 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163509 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163696 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163783 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.163998 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.164096 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.164299 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.164385 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.164650 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.165336 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.165490 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.165616 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.165835 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.165955 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166144 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166260 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166458 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166577 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166763 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.166878 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167069 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167162 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167373 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167461 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167678 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167765 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.167984 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168287 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168382 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168595 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168681 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168901 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.168988 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169229 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169319 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169544 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169632 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169848 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.169948 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170151 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170240 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170455 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170543 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170757 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.170854 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171064 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171159 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171374 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171462 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171675 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171771 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.171985 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172080 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172290 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172385 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172595 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172697 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172899 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.172993 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173229 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173320 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173531 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173619 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173833 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.173920 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174136 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174222 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174436 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174524 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174739 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.174826 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175043 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175142 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175348 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175437 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175647 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175736 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.175953 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176045 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176256 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176345 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176560 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176646 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176867 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.176965 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177235 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177346 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177542 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177632 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177852 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.177989 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178170 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178259 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178484 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178573 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178798 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.178940 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179111 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179211 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179420 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179506 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179734 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.179830 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180040 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180127 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180380 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180469 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180685 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180781 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.180989 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181092 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181321 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181410 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181627 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181717 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.181933 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182020 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182252 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182341 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182564 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182659 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182884 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.182972 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183189 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183285 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183497 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183594 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183806 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.183895 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184115 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184209 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184423 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184517 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184729 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.184816 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185040 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185167 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185374 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185470 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185684 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185770 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.185996 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186093 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186308 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186405 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186615 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186703 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.186925 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187022 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187232 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187362 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187535 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187622 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187846 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.187942 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188153 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188258 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188457 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188553 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188765 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.188854 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189085 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189182 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189409 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189496 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189716 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.189812 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190030 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190339 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190451 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190763 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.190851 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191071 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191158 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191384 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191479 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191694 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.191782 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192009 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192096 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192320 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192415 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192623 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192709 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.192942 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193042 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193277 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193378 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193655 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193742 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.193965 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194053 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194270 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194368 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194573 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194661 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194882 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.194969 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195187 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195284 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195494 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195587 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195813 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.195914 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196125 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196222 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196432 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196518 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196736 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.196824 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197114 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197253 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197386 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197491 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197711 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.197799 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198093 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198225 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198428 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198515 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198738 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.198835 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199098 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199192 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199428 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199542 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199752 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.199841 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200074 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200160 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200378 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200474 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200692 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.200781 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201002 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201187 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201344 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201431 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201658 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201746 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.201968 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202065 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202335 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202443 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202585 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202674 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.202904 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203001 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203213 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203302 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203523 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203619 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203844 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.203942 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204160 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204247 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204483 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204571 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204859 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.204948 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205205 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205300 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205531 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205632 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205838 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.205935 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206144 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206233 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206453 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206548 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206758 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.206847 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207063 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207151 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207373 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207478 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207680 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207777 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.207993 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208080 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208298 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208393 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208604 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208691 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.208909 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209004 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209249 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209363 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209561 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209650 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209863 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.209950 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210264 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210373 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210493 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210579 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210812 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.210898 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.211127 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.211222 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.211940 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212044 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212275 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212363 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212584 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212674 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212887 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.212974 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213216 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213323 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213523 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213627 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213828 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.213915 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214136 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214231 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214471 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214560 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214778 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.214865 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215100 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215195 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215414 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215510 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215750 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.215851 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216060 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216157 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216385 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216480 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216698 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.216786 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217017 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217134 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217355 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217473 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217663 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217770 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.217968 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218079 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218296 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218390 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218581 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218678 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218885 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.218972 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219202 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219290 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219494 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219588 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219806 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.219893 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220107 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220192 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220410 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220495 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220717 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.220804 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221022 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221129 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221370 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221455 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221677 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221773 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.221980 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222066 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222285 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222380 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222590 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222675 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222897 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.222985 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223204 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223299 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223536 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223628 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223844 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.223930 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224167 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224261 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224479 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224564 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224793 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.224877 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225132 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225234 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225450 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225535 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225765 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.225849 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226078 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226164 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226394 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226479 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226703 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.226788 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.227017 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.227713 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.227940 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.228093 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.228259 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.228667 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.228784 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.229136 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.229292 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.229455 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.229775 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.229897 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.230087 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.230400 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.230713 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.230804 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.231025 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.231336 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.231429 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.231646 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.231959 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.232100 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.232287 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.232594 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.232752 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.232900 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233045 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233392 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233548 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233690 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.233869 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234022 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234187 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234355 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234679 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234774 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234861 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.234940 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235153 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235248 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235460 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235547 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235775 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.235861 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236089 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236184 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236401 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236495 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236713 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.236808 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.237023 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.237218 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.237434 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.237521 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.237750 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238054 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238223 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238374 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238547 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.238855 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239008 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239153 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239302 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239462 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239630 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239788 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.239951 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240096 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240237 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240381 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240527 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240678 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.240839 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241278 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241278 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241416 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241508 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241615 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241776 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.241948 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242106 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242271 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242445 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242595 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242800 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.242942 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.243263 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.243350 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.243589 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.243897 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.243982 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.244201 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.244296 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.244510 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.244812 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.244898 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245139 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245229 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245462 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245562 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245772 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.245869 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246077 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246353 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246434 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246521 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246687 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.246773 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247080 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247217 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247394 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247571 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.247897 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248032 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248229 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248345 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248555 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248658 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248876 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.248985 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249211 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249324 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249541 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249681 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249856 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.249952 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.250164 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.250260 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.250484 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.250697 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.250783 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251049 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251136 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251372 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251460 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251680 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251765 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.251990 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252085 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252295 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252384 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252604 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252690 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.252906 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253001 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253253 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253341 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253557 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253644 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253862 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.253958 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254166 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254259 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254473 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254559 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254774 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.254866 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255076 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255162 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255378 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255464 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255680 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255767 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.255990 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256292 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256377 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256618 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256829 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.256916 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257165 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257257 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257479 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257579 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257838 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.257923 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258147 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258237 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258476 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258573 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258782 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.258875 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259092 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259195 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259391 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259476 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.259799 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260019 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260105 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260328 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260414 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260637 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260724 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.260948 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261034 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261318 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261408 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261629 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261721 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.261955 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262155 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262326 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262495 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262588 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262817 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.262903 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263154 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263337 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263480 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263670 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263796 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.263978 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264109 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264283 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264458 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264588 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264779 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.264913 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.265343 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.265436 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.265685 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.266014 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.266181 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.266353 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.266688 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.266990 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267077 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267296 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267380 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267605 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267692 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.267932 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268018 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268247 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268350 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268559 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268646 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.268871 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.269208 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.269457 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.269545 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.269829 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.269915 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270143 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270229 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270455 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270550 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270769 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.270864 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271080 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271167 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271394 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271493 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271707 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.271842 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272018 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272186 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272331 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272526 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272647 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272860 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.272988 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.273218 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.273320 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.273545 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.273639 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.273871 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.274451 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.274715 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.274814 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275039 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275125 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275370 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275456 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275681 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275779 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.275996 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.276082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.276317 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.276410 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.276902 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.277244 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.277332 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.277557 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.277654 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.277943 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278254 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278341 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278581 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278666 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278909 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.278995 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279240 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279335 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279558 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279644 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279887 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.279986 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280205 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280290 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280526 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280612 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280854 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.280959 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281199 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281290 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281538 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281624 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281852 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.281953 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282167 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282253 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282481 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282567 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282799 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.282894 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283106 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283193 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283415 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283501 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283729 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.283815 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284040 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284133 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284352 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284437 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284659 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284744 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.284966 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285052 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285300 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285385 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285607 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285694 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.285917 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286005 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286223 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286308 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286527 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286613 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286833 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.286918 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287138 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287235 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287442 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287527 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287745 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.287837 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288054 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288149 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288359 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288448 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288663 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288748 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.288968 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.289108 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.289301 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.289422 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.289666 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.290261 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.290475 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.290597 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.290788 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.290890 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291094 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291206 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291431 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291524 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291768 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.291855 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292088 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292174 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292414 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292508 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292730 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.292823 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293077 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293178 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293392 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293479 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293709 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.293794 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294031 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294191 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294346 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294432 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294657 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294742 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.294974 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295068 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295292 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295378 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295605 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295689 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.295917 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296011 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296229 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296314 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296543 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296636 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296857 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.296951 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297214 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297303 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297536 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297622 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297842 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.297936 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298166 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298251 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298482 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298575 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298804 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.298890 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299120 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299204 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299431 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299525 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299741 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.299834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300056 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300143 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300375 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300482 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300688 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.300782 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301001 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301341 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301437 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301662 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301748 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.301976 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302061 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302291 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302386 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302610 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302697 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.302920 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303005 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303247 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303339 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303576 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303670 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303886 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.303970 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304213 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304301 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304541 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304634 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304876 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.304968 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305243 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305331 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305574 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305659 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305887 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.305974 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.306134 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:27:12.306223 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.306516 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.306828 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:27:12.307075 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106014) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:27:12.458995 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO dbcounter [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Registered counter for database nova_api Sep 19 10:27:12.459213 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Registered counter for database nova_api Sep 19 10:27:12.480366 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.482424 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_db.sqlalchemy.engines [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.486925 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.488998 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writer thread running {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.543584 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.context [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8eb960d1-8620-481b-b5ca-3620f2dadac9(cell1) {{(pid=106014) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 10:27:12.545943 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.context [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8eb960d1-8620-481b-b5ca-3620f2dadac9(cell1) {{(pid=106015) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 10:27:12.547477 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:27:12.555381 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:27:12.555381 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:27:12.555574 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:27:12.555648 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:27:12.555718 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:27:12.555795 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:27:12.555875 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:27:12.555875 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:27:12.556001 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:27:12.556070 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:27:12.556138 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Registered counter for database nova_cell0 Sep 19 10:27:12.556224 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_concurrency.lockutils [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:27:12.557140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO dbcounter [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Registered counter for database nova_cell0 Sep 19 10:27:12.558904 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Registered counter for database nova_cell1 Sep 19 10:27:12.561172 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO dbcounter [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Registered counter for database nova_cell1 Sep 19 10:27:12.566337 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.570345 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.570574 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_db.sqlalchemy.engines [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.572749 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.573005 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_db.sqlalchemy.engines [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.578555 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writer thread running {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.712368 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.720241 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writer thread running {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.722113 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO dbcounter [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Registered counter for database nova_cell0 Sep 19 10:27:12.730150 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO dbcounter [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Registered counter for database nova_cell0 Sep 19 10:27:12.730784 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_db.sqlalchemy.engines [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106014) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.735784 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writer thread running {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:12.737007 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG oslo_db.sqlalchemy.engines [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:27:12.741518 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writer thread running {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:27:13.135272 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:27:13.142423 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:27:13.165670 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: WARNING keystonemiddleware.auth_token [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:27:13.172975 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: WARNING keystonemiddleware.auth_token [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:27:13.486323 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:27:13.492243 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: WARNING keystonemiddleware.auth_token [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:27:13.497631 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642ab7829c0 pid: 106014 (default app) Sep 19 10:27:13.499672 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:27:13.500864 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 19 10:27:13.501292 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Mon Sep 19 10:27:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:27:13.517592 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: WARNING keystonemiddleware.auth_token [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:27:13.523528 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: WARNING keystonemiddleware.auth_token [None req-d61ee530-b931-4e99-8bca-4a57e5e2f001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:27:13.529646 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642ab7829c0 pid: 106015 (default app) Sep 19 10:28:37.922083 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:37.923100 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 19 10:28:37.925168 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:37.936063 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_api:SELECT=3 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:37.937251 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_cell0:SELECT=3 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:37.938188 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_cell1:SELECT=3 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:37.940157 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:38.866985 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-69deb517-6640-4f2f-bfb3-d8fd60682d9c admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:38.899589 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-69deb517-6640-4f2f-bfb3-d8fd60682d9c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.968643 Sep 19 10:28:38.900250 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 19 10:28:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:28:41.520074 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:41.521131 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-25baea93-cd28-45d6-b10b-52d96020c3a0 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Sep 19 10:28:41.521537 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:41.968210 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-89b6ddf7-d9a3-4977-b736-980706c54a42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:42.084807 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-89b6ddf7-d9a3-4977-b736-980706c54a42 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.556631 Sep 19 10:28:42.085158 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:28:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:28:42.098885 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.100365 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.102334 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell1:SELECT=3 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.103086 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:28:42.306562 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-eea8fbd7-81d9-4229-a829-cce38c7c6f5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:42.423983 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-eea8fbd7-81d9-4229-a829-cce38c7c6f5a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.330408 Sep 19 10:28:42.424658 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 19 10:28:42 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:28:45.042339 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-89b6ddf7-d9a3-4977-b736-980706c54a42 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:45.043358 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-89b6ddf7-d9a3-4977-b736-980706c54a42 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 19 10:28:45.043751 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:45.697817 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-5de90508-196b-4381-b3e7-86b787ca4755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:45.836184 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-5de90508-196b-4381-b3e7-86b787ca4755 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.785870 Sep 19 10:28:45.837078 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:28:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:28:45.850059 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-71fa3c6f-cb13-4464-a4c6-70a4bb574cce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:45.952852 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-71fa3c6f-cb13-4464-a4c6-70a4bb574cce admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107483 Sep 19 10:28:45.960876 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 19 10:28:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:28:48.580533 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-5de90508-196b-4381-b3e7-86b787ca4755 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:48.581584 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-5de90508-196b-4381-b3e7-86b787ca4755 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 19 10:28:48.581982 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:48.997355 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-7dcf2849-911f-49da-a602-6c9d197d4382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "vcpus": 1, "name": "ds1G", "id": "d2", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:49.086066 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-7dcf2849-911f-49da-a602-6c9d197d4382 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497751 Sep 19 10:28:49.086805 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:28:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 10:28:49.099314 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a6e189f2-e22e-4938-8321-1e58284dbca2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:49.181922 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a6e189f2-e22e-4938-8321-1e58284dbca2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086510 Sep 19 10:28:49.182617 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 19 10:28:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:28:51.802088 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-7dcf2849-911f-49da-a602-6c9d197d4382 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:51.803107 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-7dcf2849-911f-49da-a602-6c9d197d4382 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 19 10:28:51.803505 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:52.226520 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-01542ec3-cf0e-436e-912d-4a43997e131d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:52.417191 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-01542ec3-cf0e-436e-912d-4a43997e131d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.607236 Sep 19 10:28:52.417841 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:28:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:28:52.430609 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-c2bf31ec-e852-4c95-810a-2fc8ce4b2cdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:52.507460 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-c2bf31ec-e852-4c95-810a-2fc8ce4b2cdf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081098 Sep 19 10:28:52.520809 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 19 10:28:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:28:55.116502 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-01542ec3-cf0e-436e-912d-4a43997e131d admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:55.118204 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-01542ec3-cf0e-436e-912d-4a43997e131d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Sep 19 10:28:55.118611 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:55.531496 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "ram": 4096, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:55.605501 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480755 Sep 19 10:28:55.606046 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:28:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:28:55.619453 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-d6a0a5b5-295d-4251-836e-83cc0a5bd4ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:28:55.705511 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-d6a0a5b5-295d-4251-836e-83cc0a5bd4ee admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090604 Sep 19 10:28:55.706346 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Mon Sep 19 10:28:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:28:58.315444 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:58.316506 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Sep 19 10:28:58.316937 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:28:58.734482 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-27e5a836-f674-490d-9ef6-4dd0ee015ddf admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:28:58.760822 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-27e5a836-f674-490d-9ef6-4dd0ee015ddf admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435895 Sep 19 10:28:58.761402 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 19 10:28:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:29:01.407388 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:01.408408 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-cd88902f-317c-4a17-a7ab-d68756531e64 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 19 10:29:01.408808 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:01.804705 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-4815537b-97b8-4523-bc8c-efc2369ff18a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:01.872502 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-4815537b-97b8-4523-bc8c-efc2369ff18a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.457191 Sep 19 10:29:01.873271 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:29:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:01.885814 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-14dc9229-d433-4bdd-bbcd-71fd36902790 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:01.966873 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-14dc9229-d433-4bdd-bbcd-71fd36902790 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084781 Sep 19 10:29:01.967389 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 19 10:29:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:29:04.552942 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-4815537b-97b8-4523-bc8c-efc2369ff18a admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:04.554156 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-4815537b-97b8-4523-bc8c-efc2369ff18a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Sep 19 10:29:04.554875 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:29:04.966712 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-303a57fc-8e5b-4bd4-ae2b-d53ef489cc1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:05.038325 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-303a57fc-8e5b-4bd4-ae2b-d53ef489cc1b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.477158 Sep 19 10:29:05.038877 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:29:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:05.050874 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-72a08c41-1722-478c-a18e-80367a0eeeae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:05.597322 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-72a08c41-1722-478c-a18e-80367a0eeeae admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.550043 Sep 19 10:29:05.598507 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 19 10:29:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:29:08.263879 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-303a57fc-8e5b-4bd4-ae2b-d53ef489cc1b admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:08.264887 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-303a57fc-8e5b-4bd4-ae2b-d53ef489cc1b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 19 10:29:08.265317 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:08.705694 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a8d02f9f-a10e-4d51-a54a-a2d8d24cc239 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:08.764868 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a8d02f9f-a10e-4d51-a54a-a2d8d24cc239 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.493022 Sep 19 10:29:08.765541 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:29:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:08.778700 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-dd3fa87d-d641-4b34-a8e8-dcadaf6906dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:08.783458 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:08.865709 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-dd3fa87d-d641-4b34-a8e8-dcadaf6906dd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091058 Sep 19 10:29:08.866635 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 19 10:29:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:29:11.474166 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-a8d02f9f-a10e-4d51-a54a-a2d8d24cc239 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:11.475169 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-a8d02f9f-a10e-4d51-a54a-a2d8d24cc239 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 19 10:29:11.475843 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:11.930041 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-c1e75882-2cea-4a83-8606-13e752fcc5f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "name": "m1.large", "id": "4", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:11.997875 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-c1e75882-2cea-4a83-8606-13e752fcc5f6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516007 Sep 19 10:29:11.998938 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:29:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:12.011407 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-b20a1766-c40d-4d2b-aa21-06fbc5fce938 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:12.072326 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-b20a1766-c40d-4d2b-aa21-06fbc5fce938 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064685 Sep 19 10:29:12.072780 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 19 10:29:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:29:14.724028 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-c1e75882-2cea-4a83-8606-13e752fcc5f6 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:14.724965 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-c1e75882-2cea-4a83-8606-13e752fcc5f6 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 19 10:29:14.725402 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:15.158719 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:15.166574 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:15.242986 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.510023 Sep 19 10:29:15.243535 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Mon Sep 19 10:29:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:15.256119 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-981ca397-b075-453d-ab3e-8673c2501e03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:15.311407 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-981ca397-b075-453d-ab3e-8673c2501e03 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059418 Sep 19 10:29:15.312225 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Mon Sep 19 10:29:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:29:33.035921 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:33.036951 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 19 10:29:33.037386 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:33.048117 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:29:33.422798 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-38c6d246-c497-4876-bcc2-27a068fbcfc4 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:33.440311 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-38c6d246-c497-4876-bcc2-27a068fbcfc4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396738 Sep 19 10:29:33.441378 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 19 10:29:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:29:34.743764 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:34.744763 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-9f644e6a-2e37-4be0-ae31-395d38b54046 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 19 10:29:34.745176 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:35.262079 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-99f3a6d3-2287-489d-919d-8aa2bf191dce admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:35.267498 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.wsgi [None req-99f3a6d3-2287-489d-919d-8aa2bf191dce admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-99f3a6d3-2287-489d-919d-8aa2bf191dce admin admin] Request method failure captured: Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept: application/json Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept-Encoding: gzip, deflate Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Connection: keep-alive Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Content-Length: 0 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Host: 10.222.0.42 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-System-Scope: None Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: User-Agent: python-novaclient Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Auth-Token: gAAAAABjKESOd1EEcSaMFScZ3pdxpoTAV4HGQpkZXNAA6I_bbCGhnog9uFp5m4AZxRTCN_woQSIOltu7tYiipUjw7Coq1Jg7--mds0OuRPwG7D8cgGeYJeJwe5VToHRuQO4yjOPsTjr3pUttCfaznWLo0XkKYeqK-9rNCqaW-4L6L4E1xh6zNZ4 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Id: None Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Name: None Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Identity-Status: Confirmed Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Is-Admin-Project: True Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Id: default Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Name: Default Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Name: admin Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Role: member,reader,admin Sep 19 10:29:35.272334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Roles: member,reader,admin Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant: admin Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Name: admin Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User: admin Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Id: default Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Name: Default Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Name: admin Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: method: > Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: exception: Flavor 42 could not be found. Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: action_args: {'id': '42'} Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:35.278082 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:35.279249 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.280617 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-99f3a6d3-2287-489d-919d-8aa2bf191dce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:35.281959 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-99f3a6d3-2287-489d-919d-8aa2bf191dce admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391805 Sep 19 10:29:35.281959 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 19 10:29:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:35.283882 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-d34edfaa-2b22-4f16-948a-791e1902163b admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:35.306731 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-d34edfaa-2b22-4f16-948a-791e1902163b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026440 Sep 19 10:29:35.307264 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:29:35.318168 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-8051c7a5-6302-4538-92e7-8c5ba3539456 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:35.340267 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-8051c7a5-6302-4538-92e7-8c5ba3539456 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026792 Sep 19 10:29:35.340787 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:29:35.350914 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-f286de28-b3a3-4736-ad0d-c74b8fc4d159 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:35.356703 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-f286de28-b3a3-4736-ad0d-c74b8fc4d159 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-f286de28-b3a3-4736-ad0d-c74b8fc4d159 admin admin] Request method failure captured: Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Host: 10.222.0.42 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjKESOd1EEcSaMFScZ3pdxpoTAV4HGQpkZXNAA6I_bbCGhnog9uFp5m4AZxRTCN_woQSIOltu7tYiipUjw7Coq1Jg7--mds0OuRPwG7D8cgGeYJeJwe5VToHRuQO4yjOPsTjr3pUttCfaznWLo0XkKYeqK-9rNCqaW-4L6L4E1xh6zNZ4 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Role: member,reader,admin Sep 19 10:29:35.359954 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Roles: member,reader,admin Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User: admin Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: method: > Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: exception: Flavor 42 could not be found. Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: action_args: {'id': '42'} Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:35.365481 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:35.366551 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:35.367840 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-f286de28-b3a3-4736-ad0d-c74b8fc4d159 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:35.369086 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-f286de28-b3a3-4736-ad0d-c74b8fc4d159 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014709 Sep 19 10:29:35.369086 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 19 10:29:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:36.576116 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-8051c7a5-6302-4538-92e7-8c5ba3539456 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:36.577142 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-8051c7a5-6302-4538-92e7-8c5ba3539456 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 19 10:29:36.577531 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:37.094751 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-e1e7995c-49fd-4f00-b029-82f0007ce9a2 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:37.099717 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-e1e7995c-49fd-4f00-b029-82f0007ce9a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-e1e7995c-49fd-4f00-b029-82f0007ce9a2 admin admin] Request method failure captured: Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Host: 10.222.0.42 Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjKESQqSx8IjhfKCb1jPCKhxHKrBvWxy89dLsnKLC0o2_BmotEWYcIyAgM3EmWJZuJZ68ZI2UeCVSmFSYKww-PClLl7mNhVBdUDl35eaMAxFlwXzn5Ya2dyF0ESrPnctb_t3KLnhPqtJxxmUyUHmXvV--xXv9HOdfeR2tQxBin57cKlKs Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Role: member,reader,admin Sep 19 10:29:37.101371 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Roles: member,reader,admin Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User: admin Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: method: > Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: exception: Flavor 84 could not be found. Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: action_args: {'id': '84'} Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:37.102747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:37.103637 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.104975 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-e1e7995c-49fd-4f00-b029-82f0007ce9a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:37.106334 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-e1e7995c-49fd-4f00-b029-82f0007ce9a2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389004 Sep 19 10:29:37.106334 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 19 10:29:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:37.112516 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f9093555-1704-4b81-acd1-0af8250c0bb4 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:37.127125 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f9093555-1704-4b81-acd1-0af8250c0bb4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018213 Sep 19 10:29:37.127652 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:29:37.137259 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1c4212e9-20e3-4d28-9fde-06e36c9cd3aa admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:37.153099 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-1c4212e9-20e3-4d28-9fde-06e36c9cd3aa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019260 Sep 19 10:29:37.153622 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:29:37.162755 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-1ecbd2e9-2a0d-43d0-be71-c14a18b6c3e9 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:37.167792 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.wsgi [None req-1ecbd2e9-2a0d-43d0-be71-c14a18b6c3e9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-1ecbd2e9-2a0d-43d0-be71-c14a18b6c3e9 admin admin] Request method failure captured: Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept: application/json Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept-Encoding: gzip, deflate Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Connection: keep-alive Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Content-Length: 0 Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Host: 10.222.0.42 Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-System-Scope: None Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: User-Agent: python-novaclient Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Auth-Token: gAAAAABjKESQqSx8IjhfKCb1jPCKhxHKrBvWxy89dLsnKLC0o2_BmotEWYcIyAgM3EmWJZuJZ68ZI2UeCVSmFSYKww-PClLl7mNhVBdUDl35eaMAxFlwXzn5Ya2dyF0ESrPnctb_t3KLnhPqtJxxmUyUHmXvV--xXv9HOdfeR2tQxBin57cKlKs Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Id: None Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Name: None Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Identity-Status: Confirmed Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Is-Admin-Project: True Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Id: default Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Name: Default Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Name: admin Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Role: member,reader,admin Sep 19 10:29:37.169342 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Roles: member,reader,admin Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant: admin Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Name: admin Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User: admin Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Id: default Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Name: Default Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Name: admin Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: method: > Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: exception: Flavor 84 could not be found. Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: action_args: {'id': '84'} Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:37.170918 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:37.172091 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:37.173538 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-1ecbd2e9-2a0d-43d0-be71-c14a18b6c3e9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:37.174838 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-1ecbd2e9-2a0d-43d0-be71-c14a18b6c3e9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011512 Sep 19 10:29:37.174838 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Mon Sep 19 10:29:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:38.405417 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1c4212e9-20e3-4d28-9fde-06e36c9cd3aa admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:38.406414 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-1c4212e9-20e3-4d28-9fde-06e36c9cd3aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 19 10:29:38.406814 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:38.923938 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-9f386aa7-835e-4da6-ba61-d8c72dcf684c admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:38.930586 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.wsgi [None req-9f386aa7-835e-4da6-ba61-d8c72dcf684c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-9f386aa7-835e-4da6-ba61-d8c72dcf684c admin admin] Request method failure captured: Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept: application/json Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Accept-Encoding: gzip, deflate Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Connection: keep-alive Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Content-Length: 0 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Host: 10.222.0.42 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Openstack-System-Scope: None Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: User-Agent: python-novaclient Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Auth-Token: gAAAAABjKESSdzGeCdWIZs-ldBO5Rw7QkGlSoEAlju0ho_GT7UWj6edaS8Ak8rd0PsvnpcOwiipFfoSOO2uwj_TqP5C43RD89IYfG34lGsjWmy1u9ogk0tsXGek8XR9owQEcQM5fxilD9xh1Qc4MNhXQp4dGTwq0GwKetbVGLMUk-BudErqv7C4 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Id: None Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Domain-Name: None Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Identity-Status: Confirmed Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Is-Admin-Project: True Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Id: default Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Domain-Name: Default Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Project-Name: admin Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Role: member,reader,admin Sep 19 10:29:38.932103 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Roles: member,reader,admin Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant: admin Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-Tenant-Name: admin Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User: admin Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Id: default Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Domain-Name: Default Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: X-User-Name: admin Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: method: > Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: exception: Flavor 451 could not be found. Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: action_args: {'id': '451'} Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:38.933667 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:38.934790 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: ERROR nova.api.openstack.wsgi Sep 19 10:29:38.936202 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-9f386aa7-835e-4da6-ba61-d8c72dcf684c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:38.937497 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-9f386aa7-835e-4da6-ba61-d8c72dcf684c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389480 Sep 19 10:29:38.937497 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:29:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 10:29:38.943844 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-cc1616e0-68f9-441c-bd37-085daaa0414f admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:38.958432 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-cc1616e0-68f9-441c-bd37-085daaa0414f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018802 Sep 19 10:29:38.958943 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:29:38.968020 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:38.982622 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018083 Sep 19 10:29:38.983140 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Mon Sep 19 10:29:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:29:38.992471 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c04593d9-1e5e-4362-8a35-725bc12e7e71 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:38.997287 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.wsgi [None req-c04593d9-1e5e-4362-8a35-725bc12e7e71 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c04593d9-1e5e-4362-8a35-725bc12e7e71 admin admin] Request method failure captured: Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept: application/json Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Accept-Encoding: gzip, deflate Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Connection: keep-alive Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Content-Length: 0 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Host: 10.222.0.42 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-Api-Version: compute 2.92 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Openstack-System-Scope: None Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: User-Agent: python-novaclient Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Auth-Token: gAAAAABjKESSdzGeCdWIZs-ldBO5Rw7QkGlSoEAlju0ho_GT7UWj6edaS8Ak8rd0PsvnpcOwiipFfoSOO2uwj_TqP5C43RD89IYfG34lGsjWmy1u9ogk0tsXGek8XR9owQEcQM5fxilD9xh1Qc4MNhXQp4dGTwq0GwKetbVGLMUk-BudErqv7C4 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Id: None Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Domain-Name: None Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Identity-Status: Confirmed Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Is-Admin-Project: True Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Id: default Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Domain-Name: Default Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Project-Name: admin Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Role: member,reader,admin Sep 19 10:29:38.998791 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Roles: member,reader,admin Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e8dac977aca46d48c891cd4c281d8cb", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e8dac977aca46d48c891cd4c281d8cb"}]}] Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant: admin Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Id: 1e8dac977aca46d48c891cd4c281d8cb Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-Tenant-Name: admin Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User: admin Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Id: default Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Domain-Name: Default Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Id: c847b76e4e6649e18dc342c5d998066b Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: X-User-Name: admin Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: method: > Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: exception: Flavor 451 could not be found. Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: action_args: {'id': '451'} Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:29:39.000360 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:39.001834 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: ERROR nova.api.openstack.wsgi Sep 19 10:29:39.003494 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c04593d9-1e5e-4362-8a35-725bc12e7e71 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106014) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:29:39.004501 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-c04593d9-1e5e-4362-8a35-725bc12e7e71 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011038 Sep 19 10:29:39.004501 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:29:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 10:29:40.221517 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:40.222539 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 19 10:29:40.222935 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:40.746166 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-6aa61b36-92bf-4bd5-9ef7-ab52530185d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:40.821234 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-6aa61b36-92bf-4bd5-9ef7-ab52530185d4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.459345 Sep 19 10:29:40.821783 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 19 10:29:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 10:29:42.023504 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:42.024508 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 19 10:29:42.024900 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:42.539484 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-40943540-4a15-4e37-bec1-19a32c445e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:42.613341 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-40943540-4a15-4e37-bec1-19a32c445e9a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.451670 Sep 19 10:29:42.613882 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 19 10:29:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:43.844308 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:43.845339 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 19 10:29:43.845733 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:44.366757 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-93c7a09f-6da3-4cb0-bdfd-fa3354ebe981 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:44.466530 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-93c7a09f-6da3-4cb0-bdfd-fa3354ebe981 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.483240 Sep 19 10:29:44.467075 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 19 10:29:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:45.700186 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:45.701238 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 19 10:29:45.701657 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:46.214354 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-9fd083aa-fcff-4fdb-bedd-58b7ed204ef2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:29:46.276231 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-9fd083aa-fcff-4fdb-bedd-58b7ed204ef2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.437277 Sep 19 10:29:46.277040 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Mon Sep 19 10:29:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:29:47.562743 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:47.563779 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 19 10:29:47.564176 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:29:48.084237 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-ba45e75b-8b7a-4ea4-8a89-725fca4612c7 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:29:48.104641 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-ba45e75b-8b7a-4ea4-8a89-725fca4612c7 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403597 Sep 19 10:29:48.105190 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Mon Sep 19 10:29:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:30:44.789953 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:44.790960 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-092a1c8e-cb4e-43e6-bdda-7922330e750a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 19 10:30:44.791350 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Mon Sep 19 10:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:30:44.802101 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:45.182942 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-bd4c22a5-bb53-4599-9597-03f97fddcdb4 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:45.203953 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-bd4c22a5-bb53-4599-9597-03f97fddcdb4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406475 Sep 19 10:30:45.204487 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Mon Sep 19 10:30:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:30:45.225539 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_api:SELECT=14 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:30:45.229334 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-34c8534c-e2aa-4419-8e86-48814a41a6ba admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:45.236964 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-34c8534c-e2aa-4419-8e86-48814a41a6ba admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012980 Sep 19 10:30:45.237507 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Sep 19 10:30:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:30:45.249142 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-1afefac2-8253-46d7-a4b1-a771edba0e34 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:45.257115 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-1afefac2-8253-46d7-a4b1-a771edba0e34 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011498 Sep 19 10:30:45.261815 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Sep 19 10:30:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:30:45.268858 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:45.276326 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011025 Sep 19 10:30:45.276831 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Mon Sep 19 10:30:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:30:45.288094 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-c0948e72-4f0b-4e9a-a763-d20808078a0e admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:30:45.295194 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-c0948e72-4f0b-4e9a-a763-d20808078a0e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010657 Sep 19 10:30:45.295699 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Mon Sep 19 10:30:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:34:19.829486 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:19.830494 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 19 10:34:19.830889 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:34:19.972078 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=6 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:20.111824 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:20.117052 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:20.117558 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:20.117991 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:20.118705 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:20.119156 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:20.119573 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:20.151514 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-6214d830-a0ee-49e1-a530-e6684d8c9614 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.180536 Sep 19 10:34:20.152076 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:34:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:34:21.221677 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:21.222684 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 19 10:34:21.223074 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:34:21.415758 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:21.419393 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:21.419881 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:21.420484 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:21.421310 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:21.421762 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:21.422184 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:21.441747 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-e462559b-b384-4772-8b17-0bbc73e5e517 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079799 Sep 19 10:34:21.442236 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:34:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 10:34:32.936597 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:32.937626 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 19 10:34:32.938016 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:34:33.081028 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell0:SELECT=4 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:33.081712 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_cell1:SELECT=4 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:33.082336 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG dbcounter [-] [106014] Writing DB stats nova_api:SELECT=8 {{(pid=106014) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:34:33.130191 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:33.133721 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:33.134198 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:33.134627 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:33.135343 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:33.135792 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:33.136210 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:33.162614 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-0df1cae2-9441-4602-8726-68326a96d4a5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086092 Sep 19 10:34:33.163169 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:34:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:34:34.244199 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG nova.api.openstack.wsgi [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] Calling method '>' {{(pid=106015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:34.245279 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: INFO nova.api.openstack.requestlog [None req-f8ee8381-0fde-4473-b1ba-1e0b08b79947 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 19 10:34:34.245673 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: [pid: 106015|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Mon Sep 19 10:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:34:34.436305 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG nova.api.openstack.wsgi [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Calling method '>' {{(pid=106014) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:34:34.439667 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:34.440169 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:34.440596 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:34.441325 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:34:34.441806 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:34:34.442222 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: DEBUG oslo_concurrency.lockutils [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106014) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:34:34.463649 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: INFO nova.api.openstack.requestlog [None req-afdc049a-264b-4057-9976-02bc05c9dd7c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079055 Sep 19 10:34:34.464184 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: [pid: 106014|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Mon Sep 19 10:34:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:35:33.612164 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: Mon Sep 19 10:35:33 2022 - graceful shutdown triggered... Sep 19 10:35:33.611626 dv-cinder-858275-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 10:35:33.613175 dv-cinder-858275-1-iscsi devstack@n-api.service[106014]: Gracefully killing worker 1 (pid: 106014)... Sep 19 10:35:33.613576 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: Gracefully killing worker 2 (pid: 106015)... Sep 19 10:35:33.739394 dv-cinder-858275-1-iscsi devstack@n-api.service[106015]: DEBUG dbcounter [-] [106015] Writing DB stats nova_api:SELECT=4 {{(pid=106015) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:35:34.612638 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: worker 1 buried after 1 seconds Sep 19 10:35:34.613050 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: worker 2 buried after 1 seconds Sep 19 10:35:34.613050 dv-cinder-858275-1-iscsi devstack@n-api.service[106013]: goodbye to uWSGI. Sep 19 10:35:34.614264 dv-cinder-858275-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 10:35:34.614842 dv-cinder-858275-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 10:35:34.617698 dv-cinder-858275-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 10:35:34.627382 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 10:35:34 2022] *** Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: nodename: dv-cinder-858275-1-iscsi Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: machine: x86_64 Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: clock source: unix Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: pcre jit disabled Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: detected number of CPU cores: 4 Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: current working directory: / Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: detected binary path: /usr/bin/uwsgi-core Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: your processes number limit is 47680 Sep 19 10:35:34.629404 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: your memory page size is 4096 bytes Sep 19 10:35:34.630229 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: detected max file descriptor number: 2048 Sep 19 10:35:34.630229 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: lock engine: pthread robust mutexes Sep 19 10:35:34.630229 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: thunder lock: enabled Sep 19 10:35:34.630229 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 10:35:34.630229 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 10:35:34.670024 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: Python main interpreter initialized at 0x564d22f759c0 Sep 19 10:35:34.670024 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: python threads support enabled Sep 19 10:35:34.670024 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: your server socket listen backlog is limited to 100 connections Sep 19 10:35:34.670024 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: your mercy for graceful operations on workers is 90 seconds Sep 19 10:35:34.670390 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 10:35:34.670477 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: *** Operational MODE: preforking *** Sep 19 10:35:34.670706 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: *** uWSGI is running in multiple interpreter mode *** Sep 19 10:35:34.670706 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: spawned uWSGI master process (pid: 127485) Sep 19 10:35:34.670898 dv-cinder-858275-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 10:35:34.671792 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: spawned uWSGI worker 1 (pid: 127496, cores: 1) Sep 19 10:35:34.671792 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: spawned uWSGI worker 2 (pid: 127497, cores: 1) Sep 19 10:35:34.671792 dv-cinder-858275-1-iscsi devstack@n-api.service[127485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 10:35:35.339078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 10:35:35.350807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 10:35:36.503086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:35:36.503086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: from cryptography.utils import int_from_bytes Sep 19 10:35:36.503765 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:35:36.503765 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: from cryptography.utils import int_from_bytes Sep 19 10:35:36.538330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:35:36.538330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: from cryptography.utils import int_from_bytes Sep 19 10:35:36.538812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 10:35:36.538812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: from cryptography.utils import int_from_bytes Sep 19 10:35:38.923054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:35:38.923620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:35:38.923889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:35:38.924276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:35:38.924538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:35:38.924951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.925361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.925651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.925975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.926311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.926627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.926953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.927276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.927611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.927883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.928210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.928730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858275-1-iscsi {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.929135 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.929414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.929751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.930100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.930432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.930762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.931089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.931606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.932062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.932378 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.932767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.933045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.933556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.933721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.934067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.934376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.934888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.935220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.935688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858275-1-iscsi {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.936026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.936347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.936667 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.937174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.937503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.938366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.938725 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.939057 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.939390 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.939715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.940037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.940362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.940694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.941002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.941347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.941665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.941989 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.942299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.942607 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.942863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.943175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.943503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.943828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.944158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.944417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.944671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.944993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.945350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.945663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.945974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.946285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.946594 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.946904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.947212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.947525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.947836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.948159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.948482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.948810 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.949145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.949474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.949891 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.950147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.950463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.950811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.951135 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.951449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.951773 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.952101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.952415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.952730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.953166 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.953423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.953767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.954081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.954339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.954645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.954959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.955284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.955596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.955908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.956219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.956526 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.956839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.957188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.957503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.957819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.958128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.958437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.958751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.959062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.959372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.959683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.960026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.960367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.960685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.960994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.961544 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.961874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.962191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.962505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.962815 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.963143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.963459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.963770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.964094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.964404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.964718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.965040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.965371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.965844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.966019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.966305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.966615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.966930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.967237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.967559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.967875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.968184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.968492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.968836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.969188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.969516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.969831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.970142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.970462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.970786 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.971130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.971469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.971818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.972137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.972476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.972812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.973160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.973479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.973800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.974132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.974451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.974768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.975085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.975409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.975734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.976068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.976389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.976713 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.977035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.977379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.977703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.978037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.978361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.978677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.979028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.979375 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.979695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.980026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.980356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.980679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.980994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.981340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.981688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.982006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.982324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.982644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.982959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.983284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.983603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.983919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.984235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.985175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.985408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.985755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.985942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 10:35:38.986425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.986570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 10:35:38.986701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.986701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.986976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 10:35:38.987105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.987250 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 10:35:38.987382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.987512 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 10:35:38.987641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.987771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.987914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.988054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.988192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.988332 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.988496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.988633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.988805 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.988957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.989345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.989497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.989630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.989768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.989910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.990141 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.990267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.990379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.990498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.990624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.990737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.990965 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.991086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.991305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.991437 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-858275-1-iscsi {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.991622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.991754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.991945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.992072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.992292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.992428 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.992551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.992671 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.992862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.992984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.993204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.993348 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.993517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.993639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.993846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.994050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.994195 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.994373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.994504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.994690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.994811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.995064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.995196 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.995479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.995804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.995942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.996122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.996254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.996502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.996746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.996862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.997087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.997203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.997427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.997597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.997754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.997908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.998063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.998226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-858275-1-iscsi {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.998447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.998604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.998763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.998910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.999061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.999234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.999400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.999595 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:38.999755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:38.999903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.000641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.000802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.000949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.001138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.001320 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.001483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.001629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.001792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.002219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.002379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.002525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.002679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.002825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.002985 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.003140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.003294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.003463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.003623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.003777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.003938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.004093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.004093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.004388 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.004546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.004703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.004857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.005005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.005188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.005336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.005336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.005822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.005993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.006197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.006358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.006505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.006652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.006812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.006961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.007112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.007259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.007405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.007566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.007736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.007896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.008045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.008191 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.008338 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.008484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.008646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.008792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.008945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.009112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.009267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.009413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.009586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.009735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.009880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.010025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.010178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.010334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.010495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.010649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.010802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.010956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.011111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.011257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.011417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.011576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.011722 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.011867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.012039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.012488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.012638 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.012785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.012936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.013152 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.013318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.013483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.013631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.013777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.013933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.014088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.014234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.014388 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.014560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.014708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.014860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.015014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.015180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.015349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.015505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.015661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.015991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.016146 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.016345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.016515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.016663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.016809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.016954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.017120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.017300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.017486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.017646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.017801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.017954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.018118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.018282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.018437 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.018852 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.019006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.019159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.019317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.019477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.019624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.019771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.019931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.019931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.020224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.020397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.020554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.020708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.020856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.021002 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.021203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.021360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.021507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.021652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.021799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.021953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.022109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.022543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.022709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.022866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.023019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.023167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.023322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.023468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.023614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.023768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.024098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.024262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.024434 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.024594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.024742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.024913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.025080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.025236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.025382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.025548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.025696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.025851 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.026177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.026386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.026673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.026829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.027062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.027236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.027391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.027546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.027693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.027845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.028002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.028158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.028303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.028455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.028608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.028763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.028920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.029135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.029303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.029450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.029605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.029760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.029924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.030082 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.030230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.030384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.030537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.030698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.030844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.030997 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.031167 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.031337 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.031502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.031658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.031812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.031967 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.032130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.032278 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.032687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.032891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.033045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.033229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.033378 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.033532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.033696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.033858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.034005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.034151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.034304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.034470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.035370 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.035579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 10:35:39.035734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.035889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.036043 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.036043 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.036578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.036812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.036966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.037939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.038866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.039020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.039183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.039183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.039483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.040876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.041352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.041507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.041661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.041816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.041969 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.042126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.042273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.042427 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.042795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.042966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043601 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.043904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.044818 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045313 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.045963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.046120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.046289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.046640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.047333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.047565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.047725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.047889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.048983 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049166 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.049950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.050874 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051639 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.051940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.052093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.052258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.052414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.052573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.052745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.053140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.053140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.053536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.053701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.053856 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054634 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.054936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055452 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.055925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.056071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.056227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.056384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.056559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.056919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.057185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.057353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.057509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.057766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.057920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058074 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058222 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058757 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.058912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.059984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060277 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.060882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.061974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.062269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.062269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.063321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.063321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.063619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.063788 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.063942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064096 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064544 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.064863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065501 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065661 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.065966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.066120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.066274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.066430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.066576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.066743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067087 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067238 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.067384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.068336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.068507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.068670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.068819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.068968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069313 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.069936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.070978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.071276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.071423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.071568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.071722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.071887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.072994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.073459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.073626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.073781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.073943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074456 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.074925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075633 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.075956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.076936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.077310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.077475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.077628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.077781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.078870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.079992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080793 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.080955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.081949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.082251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.082404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.082557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.082721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.082904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.083058 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.083211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.083383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.083758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.083920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084585 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.084748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085466 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085627 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.085955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086553 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086706 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.086874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.087890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.088291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.088463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.088618 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.088779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.088941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.089953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090261 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.090906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091223 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.091855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.092879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.093037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.093226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.093226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.093520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.093520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094150 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.094960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.095897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096058 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096390 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.096857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.097011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.097246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.097414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.097783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.097961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.098125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.098298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.098533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.098703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.098857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.099986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100142 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.100997 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101656 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.101977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.102942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.103096 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.103248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.103401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.103554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.103716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104288 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.104942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.105980 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106141 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.106780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.107099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.107263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.107416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.107568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.107941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.108998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.109178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.109892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110240 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.110861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111024 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111348 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.111987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.112964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.113970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.114366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.114540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.114704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.114871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.117604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.117820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.118213 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.118404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.118576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.118835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119331 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.119984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120139 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.120940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121308 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.121952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.122901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.123869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.124031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.124473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.124662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.124839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.125556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.125733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.125889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.126846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.127964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.128336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.128507 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.128671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.128856 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129097 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.129957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.130908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131072 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131563 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.131881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132202 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132508 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.132974 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.133214 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.133383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.133549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.133704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.133870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.134033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.134187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.134365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.134730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.134900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135066 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.135887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136060 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.136853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.137867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.138029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.138212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.138577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.138743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.138907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139339 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.139932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140874 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.140999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141168 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.141990 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142141 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.142953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.143066 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.143187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.143358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.143505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.143505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144146 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144268 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.144871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145502 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.145880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146352 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.146859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.147977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.148985 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.149930 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150065 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.150891 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151580 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151713 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.151858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.152385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.153949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.154083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.154225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.154446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.154583 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.154716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.155936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156082 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.156929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.157902 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158507 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.158982 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.159910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.160879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.161963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162588 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.162998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.163858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.164955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.165995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.166970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.167933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.168198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.168341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.168341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.168759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.168993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.169883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170146 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170297 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.170978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.171240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.171374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.171529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.172976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.173942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174075 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174075 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.174861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.175945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.176777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.177934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178193 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178327 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.178915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.179785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.181409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.181566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.181566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.181566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.181566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.182192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.182329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.182329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.182329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183286 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183286 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183286 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183286 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.183924 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.184063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.184206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.185656 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.185903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.186865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.187012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.187160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.187302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.187486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.188105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.188247 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.188247 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.190677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.190815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.190815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191341 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191769 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.191927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.192963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193526 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.193928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194472 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.194912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195327 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.195901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196654 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.196944 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.197634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.198492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.198642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.198642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.198914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199594 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199712 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.199976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.200112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.200244 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.200244 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.200858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.200994 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.201941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.202867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203440 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.203975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.204935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205355 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205355 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.205887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.206932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.207900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.208871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209428 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209428 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.209840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.210098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.210240 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.210489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.210745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.210745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.211978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.212161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.212488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.212852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.212995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.213212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.213384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.213546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.213727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.213828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.214858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.215067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.215241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.215389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:35:39.215525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.215738 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.216047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.216409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.216735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.217473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.217688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.218010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.218359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.219234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.219555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.219872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.220188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.220523 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.220846 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.221193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.221514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.221840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.222169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.222487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.222803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.223122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.223441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.223759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.224076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.224397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.224715 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.225033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.225383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.225738 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.226069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.226403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.226733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.227060 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.227382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.227702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.228020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.228340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.228665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.229003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.229354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.229667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.230110 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.230437 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.230766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.231098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.231420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.231751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.232092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.232412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.232741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.233137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.233423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.233772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.234110 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.235048 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.235369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.235687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.236003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.236324 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.236652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.236969 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.237310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.237625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.237945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.238257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.238571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.238883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.239195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.239514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.239825 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.240183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.240444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.240764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.241089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.242203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.242537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.242862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.243186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.243506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.243824 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.244143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.244491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.244979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.245358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.245698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.246028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.246361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.246690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.247025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.247361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.247690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.248014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.248361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.248686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.249012 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.249472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.249804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.250514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.250514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.250815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.251206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.251466 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.251803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.252140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.252474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.252798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.253150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.253495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.253819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.254141 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.254462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.254784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.255105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.255430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.255749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.256070 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.256396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.256724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.257088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.257417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.257735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.258071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.258406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.258762 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.259084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.259435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.259775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.260105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.260421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.260737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 10:35:39.260989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127497) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 10:35:39.277711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO dbcounter [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Registered counter for database nova_api Sep 19 10:35:39.298734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_db.sqlalchemy.engines [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.305510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writer thread running {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.323265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO dbcounter [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Registered counter for database nova_api Sep 19 10:35:39.343301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_db.sqlalchemy.engines [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.350545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writer thread running {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.361844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.context [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8eb960d1-8620-481b-b5ca-3620f2dadac9(cell1) {{(pid=127496) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 10:35:39.366008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:35:39.366485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:35:39.368054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:35:39.368779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:35:39.369258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:35:39.371343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:35:39.373391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO dbcounter [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Registered counter for database nova_cell0 Sep 19 10:35:39.377520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO dbcounter [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Registered counter for database nova_cell1 Sep 19 10:35:39.384687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_db.sqlalchemy.engines [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.386682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_db.sqlalchemy.engines [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.392792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writer thread running {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.395224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writer thread running {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.407692 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.context [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8eb960d1-8620-481b-b5ca-3620f2dadac9(cell1) {{(pid=127497) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 10:35:39.411836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:35:39.412319 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:35:39.413936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:35:39.414668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:35:39.415136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:35:39.417157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:35:39.422790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO dbcounter [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Registered counter for database nova_cell0 Sep 19 10:35:39.423754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO dbcounter [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Registered counter for database nova_cell1 Sep 19 10:35:39.431434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_db.sqlalchemy.engines [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.433235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_db.sqlalchemy.engines [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.438916 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writer thread running {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.441592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writer thread running {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.543116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO dbcounter [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Registered counter for database nova_cell0 Sep 19 10:35:39.550455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_db.sqlalchemy.engines [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.554791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writer thread running {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.588103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO dbcounter [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Registered counter for database nova_cell0 Sep 19 10:35:39.595138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_db.sqlalchemy.engines [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127497) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 10:35:39.599598 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writer thread running {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 10:35:39.875960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: WARNING keystonemiddleware.auth_token [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:35:39.883208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: WARNING keystonemiddleware.auth_token [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:35:39.921025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: WARNING keystonemiddleware.auth_token [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:35:39.929094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: WARNING keystonemiddleware.auth_token [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:35:40.241924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: WARNING keystonemiddleware.auth_token [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:35:40.247976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: WARNING keystonemiddleware.auth_token [None req-f06b26e4-fcf5-4fa5-8084-f971f793730b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:35:40.253324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d22f759c0 pid: 127496 (default app) Sep 19 10:35:40.278139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: WARNING keystonemiddleware.auth_token [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 10:35:40.284669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: WARNING keystonemiddleware.auth_token [None req-7e5e1804-34b4-4d26-94db-7d4e8f89f6d9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 10:35:40.290058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d22f759c0 pid: 127497 (default app) Sep 19 10:36:17.581950 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.583103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.583911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.584662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.908741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.911431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.914681 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:17.916330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:18.681004 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-383ebcad-2d33-4e47-962c-05a38b31c153 tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Action: 'create', calling method: .version_select at 0x7fb944222430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1595766743", "metadata": {"Type": "work"}}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:18.831379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f9e751cd-e8d5-4a1a-a1da-28fc3adc4907 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Action: 'create', calling method: .version_select at 0x7fb9442255e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-437209630", "metadata": {"Type": "work"}}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f9e751cd-e8d5-4a1a-a1da-28fc3adc4907 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 121 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:18.838320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-437209630", "metadata": {"Type": "work"}}} Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:18.839728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-437209630', 'metadata': {'Type': 'work'}}}} Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise error Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:18.840585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 10:36:18.844061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 10:36:18.851528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 10:36:18.851528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.851528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f9e751cd-e8d5-4a1a-a1da-28fc3adc4907 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:18.851528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f9e751cd-e8d5-4a1a-a1da-28fc3adc4907 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.946535 Sep 19 10:36:18.851528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 19 10:36:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 949 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 10:36:18.859130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b654cf41-38ba-4a49-b85f-9c05dbb7e08d tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Action: 'create', calling method: .version_select at 0x7fb944225ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1341355759", "metadata": {"Type": "work"}}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b654cf41-38ba-4a49-b85f-9c05dbb7e08d tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 120 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:18.867534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1341355759", "metadata": {"Type": "work"}}} Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:18.868814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1341355759', 'metadata': {'Type': 'work'}}}} Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise error Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi '0' Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:18.874232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 10:36:18.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 10:36:18.877361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 10:36:18.877361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.877361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b654cf41-38ba-4a49-b85f-9c05dbb7e08d tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:18.877361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b654cf41-38ba-4a49-b85f-9c05dbb7e08d tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022877 Sep 19 10:36:18.877361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 2/2] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 19 10:36:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:36:18.884831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1778e93-ff71-4dbd-b539-31f38c69b8fa tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Action: 'create', calling method: .version_select at 0x7fb9440e2280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-502795004", "metadata": {"Type": "work"}}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1778e93-ff71-4dbd-b539-31f38c69b8fa tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 118 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:18.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-502795004", "metadata": {"Type": "work"}}} Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:18.905421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-502795004', 'metadata': {'Type': 'work'}}}} Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise error Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi '' Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:18.906579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 10:36:18.907932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 10:36:18.910121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 10:36:18.910121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:18.910121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1778e93-ff71-4dbd-b539-31f38c69b8fa tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:18.910121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1778e93-ff71-4dbd-b539-31f38c69b8fa tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026593 Sep 19 10:36:18.910121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 3/3] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 19 10:36:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 10:36:18.923824 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-69cbf574-20fc-4d8d-9055-b1b56724100e tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Calling method '.version_select at 0x7fb9440e2dc0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:19.851044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-69cbf574-20fc-4d8d-9055-b1b56724100e tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] HTTP exception thrown: Volume tempest-invalid-1563708903 could not be found. Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-69cbf574-20fc-4d8d-9055-b1b56724100e tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1563708903 HTTP/1.1 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:19.855090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Volume tempest-invalid-1563708903 could not be found. Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'tempest-invalid-1563708903'} Sep 19 10:36:19.856334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1563708903 could not be found. (HTTP 404) (Request-ID: req-8cce63ef-528e-4ce8-a472-c87cc323050a) Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:19.857120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:36:19.862817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1563708903 could not be found. Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:36:19.863658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1563708903 could not be found. Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1563708903 could not be found. Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-69cbf574-20fc-4d8d-9055-b1b56724100e tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 404 to user: Volume tempest-invalid-1563708903 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-69cbf574-20fc-4d8d-9055-b1b56724100e tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1563708903" status: 404 len: 99 microversion: 2.1 time: 0.945629 Sep 19 10:36:19.864535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 4/4] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 19 10:36:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1563708903 => generated 99 bytes in 948 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 10:36:19.870967 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0462d77d-566a-427c-a821-51528ff107b9 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007289 Sep 19 10:36:19.876823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 5/5] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Sep 19 10:36:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 19 10:36:19.884621 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ceb0df2b-a3bc-48d4-80f1-85ba57b6ae2c tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005657 Sep 19 10:36:19.890238 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 6/6] 10.222.0.42 () {58 vars in 1137 bytes} [Mon Sep 19 10:36:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 10:36:19.895989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-126628db-8c74-4a3b-8b8f-9ca5a0607236 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Calling method '.version_select at 0x7fb9440133a0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:20.037678 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-126628db-8c74-4a3b-8b8f-9ca5a0607236 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] HTTP exception thrown: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-126628db-8c74-4a3b-8b8f-9ca5a0607236 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/os-volumes/e0f2b746-ab5e-41a6-b102-0750bd267685 HTTP/1.1 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:20.039629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'e0f2b746-ab5e-41a6-b102-0750bd267685'} Sep 19 10:36:20.040860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. (HTTP 404) (Request-ID: req-da2cb646-ade5-4ea6-93cf-ccefbfa6b630) Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.041620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:36:20.042735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 10:36:20.044160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-126628db-8c74-4a3b-8b8f-9ca5a0607236 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 404 to user: Volume e0f2b746-ab5e-41a6-b102-0750bd267685 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-126628db-8c74-4a3b-8b8f-9ca5a0607236 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e0f2b746-ab5e-41a6-b102-0750bd267685" status: 404 len: 109 microversion: 2.1 time: 0.150716 Sep 19 10:36:20.045838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 7/7] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:36:19 2022] DELETE /compute/v2.1/os-volumes/e0f2b746-ab5e-41a6-b102-0750bd267685 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:36:20.054041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b139cf0-d2fe-49ba-8782-3395760f4014 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Calling method '.version_select at 0x7fb9440e2280>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:20.187890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-5b139cf0-d2fe-49ba-8782-3395760f4014 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] HTTP exception thrown: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b139cf0-d2fe-49ba-8782-3395760f4014 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Request method failure captured: Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/os-volumes/36337f12-073a-4723-97d6-1ae6bd3a2efc HTTP/1.1 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYh08DMdipYAp2BD7g_L88Pz9tgjeMJ-ac4HZvGlBNM41K8BvaHOZqCltKtzvPxbAwBc0p8Q7RKLgfRWiZlHpCJRsrJ_Ajib4Tqpv74tUUTFYoU4_i5Eb548OvBjkkCp61vWgFHJ9eONiybmWu9R6qv7O6vWIsDBhr4M2llnrEz9qI Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:20.189876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dc87da0661ec4a6caef7e46c13a39482", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dc87da0661ec4a6caef7e46c13a39482"}]}] Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: dc87da0661ec4a6caef7e46c13a39482 Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesNegativeTest-1521100979 Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 7f2807b7c7db45848fe6184c9134fc21 Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesNegativeTest-1521100979-project Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '36337f12-073a-4723-97d6-1ae6bd3a2efc'} Sep 19 10:36:20.191122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. (HTTP 404) (Request-ID: req-940d7d66-fe93-4214-b322-3d94adff0fd8) Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.191891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:36:20.192909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 10:36:20.193923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b139cf0-d2fe-49ba-8782-3395760f4014 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] Returning 404 to user: Volume 36337f12-073a-4723-97d6-1ae6bd3a2efc could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5b139cf0-d2fe-49ba-8782-3395760f4014 tempest-VolumesNegativeTest-1521100979 tempest-VolumesNegativeTest-1521100979-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/36337f12-073a-4723-97d6-1ae6bd3a2efc" status: 404 len: 109 microversion: 2.1 time: 0.142663 Sep 19 10:36:20.196268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 8/8] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:20 2022] GET /compute/v2.1/os-volumes/36337f12-073a-4723-97d6-1ae6bd3a2efc => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:36:20.625895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-383ebcad-2d33-4e47-962c-05a38b31c153 tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.061559 Sep 19 10:36:20.627136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 1/9] 10.222.0.42 () {60 vars in 1156 bytes} [Mon Sep 19 10:36:17 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3064 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 19 10:36:20.643316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d1d804a2-4f3c-4995-be2e-8c2383a814f0 tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb9440e2280>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:20.726481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d1d804a2-4f3c-4995-be2e-8c2383a814f0 tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 200 len: 353 microversion: 2.1 time: 0.087806 Sep 19 10:36:20.734207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 9/10] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:20 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:21.742944 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-618000c6-fa4c-4c8b-b607-3f6c589426cf tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb9440f5310>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:21.855054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-618000c6-fa4c-4c8b-b607-3f6c589426cf tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 200 len: 353 microversion: 2.1 time: 0.117576 Sep 19 10:36:21.855488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 2/11] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:21 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:36:22.871810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b41a4b00-811f-4687-9e37-4c818e61fd8f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb9440130d0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:22.990425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b41a4b00-811f-4687-9e37-4c818e61fd8f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 200 len: 354 microversion: 2.1 time: 0.123730 Sep 19 10:36:22.993849 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 10/12] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:22 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:23.005537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a5ce8704-ca24-4e3c-92e7-2c039abf415f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb9440f5a60>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:23.057945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a5ce8704-ca24-4e3c-92e7-2c039abf415f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 200 len: 354 microversion: 2.1 time: 0.056108 Sep 19 10:36:23.072800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 3/13] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:23 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:23.084039 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f2041ed3-9ae4-4349-852c-073774934d4f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb944013700>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:23.510155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f2041ed3-9ae4-4349-852c-073774934d4f tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 202 len: 0 microversion: 2.1 time: 0.434970 Sep 19 10:36:23.511172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 11/14] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:36:23 2022] DELETE /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:36:23.519562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c81ba72f-0c61-4c22-914d-b8cb33bc2a6e tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb94408f160>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:23.598967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c81ba72f-0c61-4c22-914d-b8cb33bc2a6e tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 200 len: 353 microversion: 2.1 time: 0.075490 Sep 19 10:36:23.598967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 4/15] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:23 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:36:24.607359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-55b8ece7-bd4c-4ec0-8068-0730aac557ca tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Calling method '.version_select at 0x7fb944013f70>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:24.647759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-55b8ece7-bd4c-4ec0-8068-0730aac557ca tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] HTTP exception thrown: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-55b8ece7-bd4c-4ec0-8068-0730aac557ca tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Request method failure captured: Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 HTTP/1.1 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYhuxRAc-M9wFxTZ2uliPHVFn2VwmMAmanV9H3NBc6qcsEEvX2Tx1X3kzC4wEkhAgD2gO2c9hScoIJUqZZqzTTlH6piOQI43To5ImeIhvmDnSF4p0Pm2Ha5P1xNVQZaiL9leum0KYoG4RJGiiuD6A_XR1-M9o_XGNLGGwtvG3KHVOk Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 2998988ae7ae429ca62921ac188de9b9 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesGetTestJSON-214335279 Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:36:24.650302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2998988ae7ae429ca62921ac188de9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2998988ae7ae429ca62921ac188de9b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2998988ae7ae429ca62921ac188de9b9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2998988ae7ae429ca62921ac188de9b9"}]}] Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesGetTestJSON-214335279 Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 2998988ae7ae429ca62921ac188de9b9 Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesGetTestJSON-214335279 Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesGetTestJSON-214335279-project Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 01008443277843d5b61807b64bdd8c72 Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesGetTestJSON-214335279-project Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'd85099be-c1dd-4310-b733-ffe9ab61ad02'} Sep 19 10:36:24.651426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. (HTTP 404) (Request-ID: req-ee6a2817-be25-41c9-807e-ab2ed3697fac) Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:24.652136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:36:24.653987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 10:36:24.655517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-55b8ece7-bd4c-4ec0-8068-0730aac557ca tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] Returning 404 to user: Volume d85099be-c1dd-4310-b733-ffe9ab61ad02 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-55b8ece7-bd4c-4ec0-8068-0730aac557ca tempest-VolumesGetTestJSON-214335279 tempest-VolumesGetTestJSON-214335279-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02" status: 404 len: 109 microversion: 2.1 time: 0.049207 Sep 19 10:36:24.656888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 12/16] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:36:24 2022] GET /compute/v2.1/os-volumes/d85099be-c1dd-4310-b733-ffe9ab61ad02 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:36:30.538676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7b219f16-9d00-4565-b8d9-25cfc025c44e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: .version_select at 0x7fb9440f5f70>, body: {"keypair": {"name": "tempest-keypair-2102349038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVt3qL12fYYzDZfP/Kv32EISpwq+oYTQ7C6JojUjgfebco7+9DATKzlrBvW5oUZfQN5tRGX9XL7uPVvq+nYkU0czpdzN7ft/eXjFik5L+fAp6AfGazkdXpbES4KRUWhfg=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:30.623703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-7b219f16-9d00-4565-b8d9-25cfc025c44e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:30.631281 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-7b219f16-9d00-4565-b8d9-25cfc025c44e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:30.836703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7b219f16-9d00-4565-b8d9-25cfc025c44e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.237380 Sep 19 10:36:30.838010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 5/17] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:36:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:34.347755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-dad12488-3f61-4027-8eb4-297ce41c325d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: .version_select at 0x7fb9440135e0>, body: {"keypair": {"name": "tempest-keypair-1982888113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbXW9w+sP+CjuYcjQ51RODEpClcJPTgq2oE9YtzveUhnqOBxCVoAMPyFbnzF9VbWILOuKlD7tLYieDAzPMEI4NlJuCVMuSNDIRlkcgf8nWaBaVHmAs5ZoznX82H27mgbg=="}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:34.519321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-dad12488-3f61-4027-8eb4-297ce41c325d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for project 67ec80c3417443d7b2368506bbd4a814. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:34.541220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-dad12488-3f61-4027-8eb4-297ce41c325d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for user 6712334ebb77462daa89be58d4480846 and project 67ec80c3417443d7b2368506bbd4a814. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:34.847694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-dad12488-3f61-4027-8eb4-297ce41c325d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.854810 Sep 19 10:36:34.848005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 13/18] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:36:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:37.041266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-54857714", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "networks": [{"uuid": "d69b67b4-e387-4227-8485-27202b66f471"}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:37.274481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] validate_networks() for [('d69b67b4-e387-4227-8485-27202b66f471', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:36:37.330345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-428973918", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c"}], "security_groups": [{"name": "tempest-securitygroup--677533148"}], "key_name": "tempest-keypair-2102349038", "user_data": "}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:37.837718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] validate_networks() for [('9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:36:38.463652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:36:38.464133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:36:38.465612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:36:38.467216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:36:38.467863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:36:38.495242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:38.495242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:38.495242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:38.495242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:38.495628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:38.496253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:38.526800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Getting quotas for project a48df5556fc247fba5eaf7d3d1ecf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:38.534121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Getting quotas for user 5fecaefd115842fe80009d70921c3806 and project a48df5556fc247fba5eaf7d3d1ecf44f. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:38.573530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:36:38.577867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:36:38.792780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-045cc709-cd7e-431e-91c9-c2024f318cbc tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120018 Sep 19 10:36:38.795469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 6/19] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:36:39.251458 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f2be03f2-34b8-439b-b85b-9050332ccd0e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: .version_select at 0x7fb943fa1e50>, body: {"keypair": {"name": "tempest-keypair-1215666882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj4zjDYQPiUKJfS+rZWYVBdnYuWaZz+aRn1/XLnEPd5mbIm3SeqxtOcgV1KXfqUkdxfYqomWDSQ/POlcQqw60k7vG0vTQswDG+YckmUnGPTHHa8PjNiIWTUUTZqM10Mvg=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:39.299800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-f2be03f2-34b8-439b-b85b-9050332ccd0e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for project e3160b641b81433780d38eca696bfdf1. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:39.312543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-f2be03f2-34b8-439b-b85b-9050332ccd0e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for user d4d9bea213fa4401992d8e7894726e05 and project e3160b641b81433780d38eca696bfdf1. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:39.484168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f2be03f2-34b8-439b-b85b-9050332ccd0e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.684622 Sep 19 10:36:39.485147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 7/20] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Sep 19 10:36:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 686 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 10:36:39.495364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-43e49394-f082-4387-958b-568651fbf2c6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:39.497533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-43e49394-f082-4387-958b-568651fbf2c6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:39.676623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-43e49394-f082-4387-958b-568651fbf2c6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:39.711919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-43e49394-f082-4387-958b-568651fbf2c6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1213 microversion: 2.1 time: 0.223649 Sep 19 10:36:39.734168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 8/21] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:39 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1213 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:40.413512 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:36:40.420106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:36:40.420106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:36:40.420106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:36:40.420106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:36:40.442500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:40.445356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:40.452530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:40.452530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:40.452530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:40.452530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:40.498765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:40.504623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:40.524669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:36:40.528984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:36:40.748041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-33484f0d-e557-45a7-8920-84699471d629 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:40.748666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-33484f0d-e557-45a7-8920-84699471d629 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:40.777705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-85ff3a26-c618-40e7-b330-b2e2627e728d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.452789 Sep 19 10:36:40.789704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 14/22] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:36:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 3466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:36:40.799401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-71890a23-1fff-4e98-998d-4e913572f477 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:40.800037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-71890a23-1fff-4e98-998d-4e913572f477 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:40.948737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33484f0d-e557-45a7-8920-84699471d629 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:40.956088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-33484f0d-e557-45a7-8920-84699471d629 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1213 microversion: 2.1 time: 0.212093 Sep 19 10:36:40.966889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 9/23] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:40 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:41.170853 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-71890a23-1fff-4e98-998d-4e913572f477 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:41.207968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-71890a23-1fff-4e98-998d-4e913572f477 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1241 microversion: 2.1 time: 0.409646 Sep 19 10:36:41.210005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 15/24] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:40 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1241 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:41.746152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1271119611", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b051f35e-e823-4944-b5dc-45fc6f19108b"}], "security_groups": [{"name": "tempest-securitygroup--822003722"}], "key_name": "tempest-keypair-1982888113", "user_data": "}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:41.879977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] validate_networks() for [('b051f35e-e823-4944-b5dc-45fc6f19108b', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:36:41.991964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6033c18b-657f-4f7b-bff8-a6bcd4fd95f1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:41.993616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6033c18b-657f-4f7b-bff8-a6bcd4fd95f1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:42.602303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6033c18b-657f-4f7b-bff8-a6bcd4fd95f1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:42.612798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6033c18b-657f-4f7b-bff8-a6bcd4fd95f1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1213 microversion: 2.1 time: 0.624829 Sep 19 10:36:42.617203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 16/25] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:41 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1213 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:42.625783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5783a553-9c38-4306-8d68-6d688c9ccfc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:42.630534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5783a553-9c38-4306-8d68-6d688c9ccfc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:42.792206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5783a553-9c38-4306-8d68-6d688c9ccfc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:42.820410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5783a553-9c38-4306-8d68-6d688c9ccfc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1241 microversion: 2.1 time: 0.185675 Sep 19 10:36:42.820410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 17/26] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:42 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:43.200734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:36:43.203887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:36:43.204415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:36:43.204842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:36:43.205559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:36:43.216987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.217382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.218180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:43.218909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.219364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.219792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:43.241230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for project 67ec80c3417443d7b2368506bbd4a814. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:43.246998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for user 6712334ebb77462daa89be58d4480846 and project 67ec80c3417443d7b2368506bbd4a814. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:43.261971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:36:43.265231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:36:43.453354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-05e0b246-37f5-4314-8bfc-9dcd5c9ca509 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.711695 Sep 19 10:36:43.463107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 10/27] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:36:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:36:43.477719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d28a9349-1777-4eda-bb52-28c2741d25b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:43.477719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d28a9349-1777-4eda-bb52-28c2741d25b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:43.627850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d28a9349-1777-4eda-bb52-28c2741d25b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:43.632169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d28a9349-1777-4eda-bb52-28c2741d25b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1238 microversion: 2.1 time: 0.168646 Sep 19 10:36:43.641359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:43.643940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:43.651632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 18/28] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:43 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1238 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:43.665251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.668251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.673901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:43.675211 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.677880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.682544 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:43.845153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:43.845153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:43.854546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.860832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.865695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:43.868529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:43.869159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:43.872790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:44.185537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:44.201927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d64c08f6-674b-4953-bb48-3a9c32a633d2 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1265 microversion: 2.1 time: 0.565254 Sep 19 10:36:44.203514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 11/29] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:43 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1265 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:44.232589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:44.248271 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-eccafd6f-f5a6-4068-b08e-3cc14b63c187 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1245 microversion: 2.1 time: 0.420086 Sep 19 10:36:44.249284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 19/30] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:43 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1245 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:44.682006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-964b166e-8e1b-4e67-ba33-d9600626e505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:44.686604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-964b166e-8e1b-4e67-ba33-d9600626e505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:44.801572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-964b166e-8e1b-4e67-ba33-d9600626e505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:44.819879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-964b166e-8e1b-4e67-ba33-d9600626e505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1238 microversion: 2.1 time: 0.141850 Sep 19 10:36:44.827159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 12/31] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:44 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:45.094550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-790779457", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4b8524c-7971-4971-b615-0e1396b631d7"}], "security_groups": [{"name": "tempest-securitygroup--719566454"}], "key_name": "tempest-keypair-1215666882", "user_data": "}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:45.228077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:45.228694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:45.236576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.237085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.237549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:45.252930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.252930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.253158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] validate_networks() for [('d4b8524c-7971-4971-b615-0e1396b631d7', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:36:45.259078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:45.496288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:45.515577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-354d6a88-7fb3-4263-a3c8-05b400cfb012 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1283 microversion: 2.1 time: 0.291273 Sep 19 10:36:45.537416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 13/32] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:45 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1283 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:45.548144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:45.549208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:45.555969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.556727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.557401 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:45.560106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.560106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.560106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:45.630447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:45.640750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-48b2cd45-273e-4e13-9b67-6e1dc4580bc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1293 microversion: 2.1 time: 0.101897 Sep 19 10:36:45.659359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 14/33] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:45 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:45.855326 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:45.855967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:45.877613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.878120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.878615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:45.879413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:45.879871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:45.882032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.057352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:36:46.057697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:36:46.058267 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:36:46.058865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:36:46.059449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:36:46.069099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.069614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.070063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.070781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.071237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.071654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.094358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for project e3160b641b81433780d38eca696bfdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:36:46.098316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for user d4d9bea213fa4401992d8e7894726e05 and project e3160b641b81433780d38eca696bfdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:36:46.110622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:36:46.115357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:36:46.133232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:46.146240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-839085c0-9969-4eff-a4b2-5eef8f80eddf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1242 microversion: 2.1 time: 0.298913 Sep 19 10:36:46.146591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 15/34] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:45 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1242 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:46.278007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-750d9605-50b5-4545-a82a-8441caad300c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.188189 Sep 19 10:36:46.280127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 20/35] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Sep 19 10:36:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 19 10:36:46.290526 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:46.295250 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:46.478398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:46.490595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:46.492440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:46.502985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b10eb562-101b-4360-9e8a-1afda24a9ea1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1281 microversion: 2.20 time: 0.216186 Sep 19 10:36:46.521404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 16/36] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:46 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:46.553417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:46.554062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:46.572761 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.576068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.576582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.581617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.582188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.582640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.669747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:46.670660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:46.694308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.699830 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.700543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.718913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:46.718913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:46.718913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:46.802728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:46.814963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d1ed4255-9471-4a8e-9344-e317b6bae86a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1271 microversion: 2.1 time: 0.265604 Sep 19 10:36:46.815792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 21/37] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:46 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1271 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:47.054177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:47.084580 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-be91416b-f9ff-429c-9c63-959e44940a64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1299 microversion: 2.1 time: 0.421149 Sep 19 10:36:47.087050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 17/38] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:46 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1299 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:47.170491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:47.171175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:47.188302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:47.188302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:47.188302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:47.188992 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:47.189932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:47.190651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:47.309730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:47.328226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-35720e89-888e-4f50-af49-90ced40298f4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1290 microversion: 2.1 time: 0.155766 Sep 19 10:36:47.334619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 22/39] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:47 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1290 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:47.533323 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:47.534007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:47.740147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:47.749265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:47.770665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:47.772252 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f5f9649d-bc3c-4c70-954f-cfa89e149242 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1281 microversion: 2.20 time: 0.242861 Sep 19 10:36:47.775683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 18/40] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:47 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1281 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:47.847833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:47.848406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:47.860317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:47.861215 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:47.861838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:47.862718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:47.864469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:47.869781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.116028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:48.116621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:48.150746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.151465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.152476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.167180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.167998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.168912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.620330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:48.672981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3388dca2-4bbb-4e3a-b5da-c0112dfc8d80 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.828977 Sep 19 10:36:48.674276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 23/41] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:47 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:48.679135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:48.679995 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:48.686447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.687179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.687818 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.688714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.689393 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.689990 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.872691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:48.905836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d84d0267-05b4-4bda-a7ec-638ce39e1ddd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1296 microversion: 2.1 time: 0.227340 Sep 19 10:36:48.906446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:48 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:48.927691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:48.929044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:48.959347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.959347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.959347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:48.959347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:48.959919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:48.965493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:49.148446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:49.178022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-65fc3c71-d270-4bf7-a28b-174369deddb6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1299 microversion: 2.1 time: 1.068045 Sep 19 10:36:49.211601 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:48 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1299 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:49.273473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:49.292147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:49.293872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:49.296787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5919e3e5-f473-44d7-a9cd-cdf5f781ac6b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1285 microversion: 2.20 time: 0.383479 Sep 19 10:36:49.298838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 25/44] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:48 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1285 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:49.708920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:49.710406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:49.723613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:49.724092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:49.728318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:49.729050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:49.729603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:49.733472 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:49.966131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:49.966131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:49.991489 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:49.992021 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:49.992503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.003250 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:50.008177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:50.010056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.159714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:50.174046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3240f80e-60d4-41f7-84a7-8fa05d5d6a6e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1296 microversion: 2.1 time: 0.238891 Sep 19 10:36:50.175084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 26/45] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:49 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1296 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:50.215285 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:50.215858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:50.223841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:50.224420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:50.224791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.225568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:50.226055 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:50.226472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.426797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:50.441506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-aa06fbe6-77af-4b60-8d33-e49cc1386fe5 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.734652 Sep 19 10:36:50.442702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 20/46] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:49 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:50.451126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:50.451782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:50.483718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:50.490859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:50.492056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.495551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:50.497807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:50.497807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:50.809832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:50.824441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-633754ce-2eb4-412c-b687-0c52da87fba2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.610101 Sep 19 10:36:50.830058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 27/47] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:50 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:51.025205 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:51.037288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:51.047327 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:51.056244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d0f3609b-a3e3-4120-aa4b-a225b85a708d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1333 microversion: 2.20 time: 0.611318 Sep 19 10:36:51.058532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 21/48] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:50 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1333 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:51.204135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:51.206009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:51.214590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.215307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.216050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.217815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.218409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.218970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.468297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:51.473659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:51.490366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.491602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.494539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.495975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.503486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.504239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.644590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:51.657269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f2cbb45e-79d6-47c1-9236-cc79ced063e5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.457756 Sep 19 10:36:51.673230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 28/49] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:51 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:51.852734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:51.854490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:51.868621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:51.869626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.870268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.872957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.874493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:51.875073 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:51.875545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:51.887609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c3cfc879-821a-428d-8e69-bc7c15193fac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.424242 Sep 19 10:36:51.901130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 22/50] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:51 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:52.087039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:52.089939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:52.103850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.107724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.108514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.112007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.112662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.114170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.254756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:52.264922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:52.266958 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:52.268556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b3248a99-82f4-4007-b7a8-ad2fecad24ad tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1341 microversion: 2.20 time: 0.188080 Sep 19 10:36:52.291474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 23/51] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:52 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1341 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:36:52.493288 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:52.517842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-afae6e49-c2ef-4985-a1d3-a447af6dbdc7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.654623 Sep 19 10:36:52.517842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 29/52] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:51 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:52.664656 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cd7fc03-1a62-4bae-a090-83b98557ca2c", "tag": "ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:52.686283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:52.687194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:52.688134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:52.692739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.693763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.694487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.696822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.697350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.697796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.699038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.699493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.699918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.743175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Creating event network-changed:ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85 for instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c on hv-cinder-85827 Sep 19 10:36:52.744786 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 10:36:52.748413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-27b6b72b-6738-4627-90f8-eb23cae45218 req-80c6faa2-d2e8-4785-8961-2084f865c566 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 10:36:52.751568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.752818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.755238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.757580 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.758326 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.759777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.795103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.compute.rpcapi [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 10:36:52.800487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2df822-e56e-4f94-a962-431803283478 None None] Releasing lock "compute-rpcapi-router" {{(pid=127496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 10:36:52.849670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1a2df822-e56e-4f94-a962-431803283478 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275109 Sep 19 10:36:52.849670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 24/53] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:52.940106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:52.940818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:52.968498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.970735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.976929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:52.976929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:52.976929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:52.976929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:53.317650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.326594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-094bc34f-08cd-4922-af74-0533d270f3d7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.646585 Sep 19 10:36:53.332666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 30/54] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:52 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:53.339436 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.339794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:53.346871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:53.354825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-766999c4-e8cb-4a9f-beda-3874c2df719b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.432433 Sep 19 10:36:53.355574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:53.356445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:53.356933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:53.357770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:53.372839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:53.372839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:53.373649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 25/55] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:52 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:53.509380 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.519667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.521525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.522750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7b13af43-2f45-4c63-b2d4-52df65590322 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1339 microversion: 2.20 time: 0.188730 Sep 19 10:36:53.523486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 31/56] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:53 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1339 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:53.538287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:53.539132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:53.548971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:53.549617 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:53.550406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:53.551671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:53.552203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:53.552699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:53.721990 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:53.730247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-198e96d1-063d-487a-9e74-50e448c744b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.196695 Sep 19 10:36:53.730923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 26/57] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:53 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:54.359525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:54.363519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:54.367504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.368361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.369171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.371363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.372185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.372628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.399982 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2a3428-631d-490f-8f6b-23b4a1b0c30e", "tag": "30e156f6-3b5b-49b1-b29a-66c1049d478b"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:54.413483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.413990 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.414423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.441344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Creating event network-changed:30e156f6-3b5b-49b1-b29a-66c1049d478b for instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e on hv-cinder-85827 Sep 19 10:36:54.441344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 10:36:54.441344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-be5bb8d8-1052-446b-a35c-2de1382ba283 req-f90e1608-e272-4775-b1ee-aa112658ce7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 10:36:54.441344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.441344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.441674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.441674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.445687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.446425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.459568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.compute.rpcapi [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 10:36:54.460728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] Releasing lock "compute-rpcapi-router" {{(pid=127497) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 10:36:54.509379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1edbdf02-8cb2-4294-ad3f-3b28fc7f7e76 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272973 Sep 19 10:36:54.511184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 32/58] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:54.519296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:54.520538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:54.532657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.536336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.538640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.538640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.538640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.540972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.573760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.585308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c71f06d8-b2fd-447b-a1a0-b30f9155302d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.229664 Sep 19 10:36:54.589663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:54 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:54.598756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:54.602235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:54.611474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.611965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.612546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.613443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.613905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.614331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.707455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.717103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1a002636-d0b4-4687-a896-fb50b26ec0a1 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.203419 Sep 19 10:36:54.729609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 33/60] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:54 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:54.748738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.754782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:54.755655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:54.758490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.759718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.761586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bb0b610f-4ac3-4a7b-8833-8c7f56f94232 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.170422 Sep 19 10:36:54.762231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 28/61] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:54 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:54.763235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.763731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.764171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.764879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.765363 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.765971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.917563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:54.925243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fdb835da-3cbc-4e92-97dd-ebea5fc8bc22 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.174526 Sep 19 10:36:54.925815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 34/62] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:54 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:54.967848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7407bb-0aa4-4535-8b17-e90cd88cf96d", "tag": "46456a98-39a8-4dce-9255-b1a67d65e7e9"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:36:54.978740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:54.978740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:54.979128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:54.990294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] Creating event network-changed:46456a98-39a8-4dce-9255-b1a67d65e7e9 for instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d on hv-cinder-85827 Sep 19 10:36:54.995698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-1ffcce1d-7e01-4612-8d61-292a2cc39b72 req-1de0a6cf-e518-455f-95f5-c18c4fe87279 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Sep 19 10:36:54.996292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 29/63] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:36:55.613083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:55.613083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:55.616474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.616956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.617420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.618109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.618642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.619062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.747558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:55.748374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:55.768579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.769727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.770339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.771063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.771522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.772529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.791987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:55.800383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-775990fc-1cd6-4df7-b305-5cfa54aeb93e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.194465 Sep 19 10:36:55.800955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 35/64] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:55 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:55.813550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:55.814264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:55.820476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.821050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.821575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.822378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:55.822895 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:55.823379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:55.828867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:55.976293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:55.976425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:55.978835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:55.984420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1ea51b3d-ad0e-455f-8089-0fec781f925f tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.248422 Sep 19 10:36:55.984994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 30/65] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:55 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:36:55.985139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:55.990021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:55.990820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:55.996219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:55.997605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-96ccb92c-a677-47d0-97ca-a48d88c0694f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.187971 Sep 19 10:36:56.004063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:56.004063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:56.004482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 36/66] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:55 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:56.004555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:56.004555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:56.004555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:56.004555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:56.256662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:56.265014 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-88ec6e5e-c396-4b37-a286-bf952c8f4390 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.278545 Sep 19 10:36:56.265658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 31/67] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:55 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:56.824182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:56.825529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:56.827609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=24 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:56.829995 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:56.836607 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:56.837194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:56.837792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:56.843328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:56.843962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:56.844557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:56.991391 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.008386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-436d4ce3-2184-48c6-8a2e-d94d1bd09653 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.188425 Sep 19 10:36:57.009759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 37/68] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:56 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:57.023957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:57.024719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:57.029951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:57.030948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:57.035621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.036197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.036861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.037731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.038615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.038941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.053284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.054243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.054872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.055894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.056530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.057347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.238634 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.258005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-48403033-9445-44e3-be50-48be634d8063 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.250730 Sep 19 10:36:57.285332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 32/69] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:57 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:57.299771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:57.300819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:57.308758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.323003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.324360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.324935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.325690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:57.326131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:57.330991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:57.331111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.331111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.331111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2c3d8909-42b1-44a1-9722-a309aff88e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.306790 Sep 19 10:36:57.351869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 38/70] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:57 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:36:57.704510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:57.715086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-80cb1169-7f59-4d09-bcb9-2474505a3905 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.427879 Sep 19 10:36:57.716987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 33/71] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:57 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:58.036205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:58.037805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:58.045318 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.054968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.054968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.054968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.054968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.055403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.285599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:58.309170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:58.309170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=30 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:36:58.309170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.309170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.309170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.309678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.309678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.309678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.382080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:58.397726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8c09473e-2b94-4629-8165-2bde53ae1d32 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.365698 Sep 19 10:36:58.398627 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 39/72] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:58 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:58.418011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:58.418635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:58.436842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.440735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.441303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.442114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.442747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.443323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.908672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:58.926978 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9936f102-feee-4d00-887f-db196fb351b6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.644181 Sep 19 10:36:58.932287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 34/73] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:58 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:36:58.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:58.968957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:58.979484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.980721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.981355 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:58.982233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:58.983122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:58.983757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:59.127063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:59.136979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:59.139628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:36:59.141008 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c354d553-0b74-4d16-9430-347436f2667d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.741429 Sep 19 10:36:59.145884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 40/74] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:36:58 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:36:59.426189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:36:59.426813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:36:59.438411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:59.438411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:59.438411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:59.438411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:36:59.438703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:36:59.438703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:36:59.999890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.001888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.009415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ec97dcae-9b96-4826-9788-04df57f00f88 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 1.050852 Sep 19 10:37:00.013398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 35/75] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:58 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:00.018987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6f54e35c-287e-4b93-8d90-ce60e48082b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.595977 Sep 19 10:37:00.019763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:36:59 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:00.022940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:00.023673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:00.081524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:00.082367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:00.082984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:00.083859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:00.084619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:00.086071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:00.180104 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:00.180774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:00.200766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:00.201819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:00.202455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:00.203626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:00.204469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:00.205350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:00.335959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.344898 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ec1ed3b1-d689-404a-97b7-cf6ed5b23ccf tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.330203 Sep 19 10:37:00.345833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 36/77] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:00 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:00.388040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:00.437380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:00.438245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:00.438876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:00.458067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] Creating event network-changed:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:37:00.468953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-e2ebd56e-0570-4143-b4e3-96a1a2f8a9b8 req-bde60dab-6ad9-49bd-bb5c-1d2feba6f870 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091835 Sep 19 10:37:00.472712 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 37/78] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:37:00.649127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.671479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.674023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:00.676979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-eeb238fd-4ada-4188-98d0-39ad48927e36 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.506099 Sep 19 10:37:00.682378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 42/79] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:00 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:01.046534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:01.047252 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:01.051582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:01.052194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:01.061369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.061799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.062311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.063352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.063943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.064143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.064754 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.065010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.065240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.065980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.066440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.066870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.244990 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:01.248953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-487e5fff-236e-486b-b758-38422df6030d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.206573 Sep 19 10:37:01.256100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 38/80] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:01 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:01.367745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:01.371207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:01.387007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.390374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.397272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.397272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.397272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.397272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.461539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:01.470111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a6d790f1-8104-437f-92ca-2099c287c34c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.422295 Sep 19 10:37:01.470684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 43/81] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:01 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:01.729424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:01.741772 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fb3c779f-49c4-4fd5-8f91-b6b193904171 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.377502 Sep 19 10:37:01.743466 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 39/82] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:01 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:01.863944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:01.864696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:01.871601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.872889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.872889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:01.873441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:01.873914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:01.874346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.017557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.025850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.027298 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.028483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f08284af-91da-4989-a07a-6d4895b62282 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.168731 Sep 19 10:37:02.029041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 44/83] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:01 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:02.280829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:02.281475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:02.288185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.289854 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.292705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.293909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.294988 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.296381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.489384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.492539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:02.493385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:02.498445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-961aac3f-74b6-459f-8c74-8d46f4b6171e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.221452 Sep 19 10:37:02.499527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 40/84] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:02 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:02.501344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.502108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.502714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.503446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.503900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.504325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.673341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.682094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-002017e4-37a9-43ba-b5a2-3ce3232a8c89 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.193985 Sep 19 10:37:02.697438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 45/85] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:02 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:02.765148 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:02.766316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:02.773517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.774003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.774443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.775134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:02.776073 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:02.776866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:02.793531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:02.919951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:02.927511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a5fee801-653d-437b-865c-a7c932d6b279 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.166534 Sep 19 10:37:02.928073 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 41/86] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:02 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:03.053533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:03.058060 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:03.061252 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.061746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.062190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:03.062885 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.063341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.063770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:03.200859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:03.207642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:03.209506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:03.210711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-044e103d-f8d0-4e74-9755-310f40aae1a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.160921 Sep 19 10:37:03.211580 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 46/87] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:03 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:03.523572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:03.524189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:03.538790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.539701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.540335 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:03.541036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.541813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.542980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:03.705158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:03.706469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:03.717618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.718403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.719039 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:03.724354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:03.725221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:03.728763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:04.048521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.067041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e3fc8913-a881-4b37-832d-d018197d5cc9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.548106 Sep 19 10:37:04.098026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 42/88] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:03 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:04.104427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.106977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:04.109792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:04.114942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-59d1d61a-8c97-4bc1-a229-37f1bbfab298 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.412173 Sep 19 10:37:04.115557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 47/89] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:03 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:04.138707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:04.139498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:04.140696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:04.142417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:04.143112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:04.143619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:04.236780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:04.237574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:04.243677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:04.244177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:04.244607 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:04.247504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:04.247970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:04.249126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:04.351630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.361640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5ace8ede-018f-4437-a307-5d0859ad3bef tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.262186 Sep 19 10:37:04.362562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 43/90] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:04 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:04.408065 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.413943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.415500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:04.417354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-009b8609-71b3-47c9-84f6-16c2b2332c6d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.183928 Sep 19 10:37:04.418006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 48/91] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:04 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:37:05.092909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:05.094200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:05.100830 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.101585 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.102255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.103114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.103899 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.105389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.142878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:05.143581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:05.148102 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:05.157521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.158024 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.158748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.160416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.162365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.162811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.319152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.339229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1f32cf77-799e-4c4b-896f-967d3c5943b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.248140 Sep 19 10:37:05.341527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:05 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:05.376361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.384361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:05.385016 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:05.387577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9c6d6d57-8280-4355-a19e-d3bf6dcf6ac9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.246938 Sep 19 10:37:05.388655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 49/93] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:05 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:05.402700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.403616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.404124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.404901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.405471 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.405964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.448826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:05.448826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:05.453405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.453953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.454386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.455660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:05.456144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:05.456973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:05.590922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.598786 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8a60b253-87cc-40a5-ba02-44fde5f33793 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.218863 Sep 19 10:37:05.599497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 45/94] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:05 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:05.617626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.626616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.628064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:05.629296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0b54db98-72a5-4757-9b23-4b95e8ee8124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.190109 Sep 19 10:37:05.629852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 50/95] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:05 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:06.365203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:06.365698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:06.371720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.372204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.372819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.373545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.373992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.374416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.417385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:06.418266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:06.434481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.435006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.435466 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.436178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.436643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.437093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.606453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.617036 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-23c41575-19fa-4a35-b4fa-6157207ca02d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.203945 Sep 19 10:37:06.617570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.628801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 51/96] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:06 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:06.628801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:06.628801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:06.629961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.630625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.631067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.631763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.632219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.632642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.644911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bd30577d-5c30-45a8-930b-f0e19cb15473 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.284116 Sep 19 10:37:06.646084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 46/97] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:06 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:06.668831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:06.669691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:06.676166 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.677603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.678064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.678896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:06.679360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:06.679876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:06.863260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.868083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:06.873482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f713d643-449e-4b7b-833a-9e72de466126 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.254113 Sep 19 10:37:06.875373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 52/98] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:06 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:06.881348 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.895340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.897036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:06.901003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d3672b86-7972-459a-902e-b29b0f991d27 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.245410 Sep 19 10:37:06.902072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 47/99] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:06 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:07.644369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:07.645096 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:07.652313 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.652895 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.653427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.654194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.654736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.655241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.677725 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:07.678305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:07.684902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.685542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.686326 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.687471 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.688198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.688981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.694884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:07.825016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:07.834114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-227dde8a-f630-4966-bfbe-0ae97e83caca tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.194029 Sep 19 10:37:07.834730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 53/100] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:07 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:07.880648 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:07.889760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8a5eb970-85af-46ce-ad7b-d497b5d5b2ab tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.215970 Sep 19 10:37:07.890731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 48/101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:07 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:07.904991 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:07.905776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:07.912256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.912892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.913510 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.914358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.914793 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.916418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.936501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:07.937128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:07.945294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.945789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.946258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:07.946956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:07.947413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:07.948452 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:08.138187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:08.152743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:08.153035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:08.155086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:08.156931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-03d1a933-85fa-4a54-bca1-67c44e1086d8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.230404 Sep 19 10:37:08.159392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 49/102] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:07 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:08.162747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-70c47aa0-bf7c-45d8-9d5b-a566838c68ac tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.263134 Sep 19 10:37:08.164724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 54/103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:07 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:08.856093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:08.856840 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:08.865449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:08.866504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:08.867151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:08.868080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:08.868901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:08.870411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:08.925347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:08.928381 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:08.942656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:08.943562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:08.944644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:08.945563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:08.946102 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:08.946846 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.098028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.120278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a4dfc261-23b9-4ca6-ba8a-a449dd9c022f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.268055 Sep 19 10:37:09.133826 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 50/104] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:08 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:09.138785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.148371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-29712a0d-f5a7-41c4-9503-b9794d25cddf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.233188 Sep 19 10:37:09.150783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 55/105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:08 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:09.200248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:09.200248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:09.200898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:09.201611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:09.206082 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:09.206641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:09.207075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.207759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:09.208210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:09.208506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:09.208611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.209014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:09.209474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.210159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:09.210636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:09.211248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.457517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.472165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.473710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.476828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6207c248-a175-4715-803c-428c1b715d46 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.280906 Sep 19 10:37:09.499268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 56/106] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:09 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:09.576648 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd7fc03-1a62-4bae-a090-83b98557ca2c", "name": "network-vif-plugged", "status": "completed", "tag": "ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:09.586569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:09.587372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:09.587984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:09.604023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] Creating event network-vif-plugged:ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85 for instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c on hv-cinder-85827 Sep 19 10:37:09.615863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-0b1e95fb-5c9b-43c1-bc6e-098b41bc0c9b req-81b5becd-4ae8-4c7b-9f59-edde4a2b1b99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115205 Sep 19 10:37:09.615863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 57/107] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:09.673126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:09.681012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-78b2c9db-9ecf-484a-ae3b-7a79f4ec1716 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.486723 Sep 19 10:37:09.682037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 51/108] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:09 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:10.148041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:10.150113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:10.159744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.160624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.161337 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.162367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.163171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.163867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.180705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:10.181400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:10.188415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.188899 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.189600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.190303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.190784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.191209 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.360052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.370737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f4063c89-04d6-4cec-8813-7d80cc8af1da tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.227391 Sep 19 10:37:10.382485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 58/109] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:10 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:10.452410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.461013 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f925c4bb-a200-4646-93bc-315cc8f1e41a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.285012 Sep 19 10:37:10.461711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 52/110] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:10 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:10.509030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:10.509699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:10.524085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.524085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.524085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.524085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.524657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.524657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.687691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.699613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.701054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.702219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-64c02775-d658-4212-8bda-1e41eaec2b5d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.197092 Sep 19 10:37:10.702775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 59/111] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:10 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:10.713966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:10.713966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:10.715053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.715769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.716604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.717526 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:10.718257 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:10.718866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:10.856797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:10.871449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fe3e6fcc-4357-40d5-bdb8-0d9b26fec93a tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.167583 Sep 19 10:37:10.872286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 53/112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:10 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:11.393457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:11.394066 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:11.402906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.403541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.404052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.404965 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.405585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.406200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.485346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:11.487264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:11.495467 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.495961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.496399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.497117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.497737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.498614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.677190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:11.685622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a03ad341-f599-4c61-885d-1b31d67debe7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.204654 Sep 19 10:37:11.686424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 54/113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:11 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:11.698745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7407bb-0aa4-4535-8b17-e90cd88cf96d", "name": "network-vif-plugged", "status": "completed", "tag": "46456a98-39a8-4dce-9255-b1a67d65e7e9"}, {"server_uuid": "fa2a3428-631d-490f-8f6b-23b4a1b0c30e", "name": "network-vif-plugged", "status": "completed", "tag": "30e156f6-3b5b-49b1-b29a-66c1049d478b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:11.702152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.702637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.703067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.718101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Creating event network-vif-plugged:46456a98-39a8-4dce-9255-b1a67d65e7e9 for instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d on hv-cinder-85827 Sep 19 10:37:11.718540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] Creating event network-vif-plugged:30e156f6-3b5b-49b1-b29a-66c1049d478b for instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e on hv-cinder-85827 Sep 19 10:37:11.725981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-c8099614-47dd-4d67-988e-ec2c9b98c115 req-1ec6cbb1-1d61-45aa-af57-2b61839c9114 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038269 Sep 19 10:37:11.726652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 55/114] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:11.732842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:11.733603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:11.740641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.741163 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.741596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.742298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.742746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.753160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.787274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:11.796643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6726d59e-3861-414b-8b8e-0a05ce3cb621 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.407547 Sep 19 10:37:11.797253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 60/115] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:11 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:11.933460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:11.933460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:11.949663 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.951687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.953178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.954187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:11.956135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:11.957031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:11.961996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:11.973739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:11.979578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:11.982846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5d751813-dda8-40f4-a1cc-837ab8e36066 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.255038 Sep 19 10:37:11.983664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 56/116] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:11 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:12.131502 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:12.141688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c24be798-23f1-4d4d-a2a2-5d77ea6b3b26 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1313 microversion: 2.1 time: 0.238523 Sep 19 10:37:12.142127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 61/117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:11 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:12.708964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:12.710254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:12.716981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:12.717686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:12.718458 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:12.719385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:12.719999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:12.720593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:12.821249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:12.828716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:12.833309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:12.833813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:12.834262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:12.834987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:12.835528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:12.835866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:12.958745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:12.967613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ba277bd8-24ef-4a25-80c6-20bb717291ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.262619 Sep 19 10:37:12.968383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 57/118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:12 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:13.011587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:13.012357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:13.018907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.019527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.020104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:13.020911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.021536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.022063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:13.028798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:13.036787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-533d1186-967d-4441-96ef-788233a5344f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.220090 Sep 19 10:37:13.037395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 62/119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:12 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:13.152455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:13.165366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:13.165822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:13.170199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:13.172046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:13.172853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-820913be-1469-4c19-b60b-7c660811cee8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.165779 Sep 19 10:37:13.185253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 58/120] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:13 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:13.185429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.185429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.185429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:13.185429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.185754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.185754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:13.343444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:13.350050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-32b568bd-a346-4630-b78c-f7ec96a7e133 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1501 microversion: 2.1 time: 0.188685 Sep 19 10:37:13.350790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 63/121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:13 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:13.742896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "name": "network-vif-plugged", "status": "completed", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:13.772287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.773417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.774023 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:13.790282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] Creating event network-vif-plugged:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:37:13.796882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-3111283c-28ca-4c38-8362-1ec8cf3cdd78 req-02816028-64a0-47f0-926c-23620cd62bb6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057310 Sep 19 10:37:13.800659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 59/122] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:13.990779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:13.991427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:13.997865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:13.998486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:13.998920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.000053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:14.000852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:14.001460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.060937 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:14.061902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:14.082800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:14.083296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:14.083732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.084605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:14.085255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:14.085685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.217042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:14.227423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1fdca33-e81c-4da5-b8ca-f39ba0eb9a0a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1366 microversion: 2.1 time: 0.240095 Sep 19 10:37:14.228212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 64/123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:13 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:14.233997 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:14.234887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:14.244860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:14.245877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:14.246518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.247460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:14.248230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:14.248951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:14.336517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:14.344974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-319b8cd3-0940-4533-b8f5-6ddc3486c148 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1363 microversion: 2.1 time: 0.288793 Sep 19 10:37:14.347143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 60/124] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:14 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:14.453611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:14.464463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:14.466520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:14.468384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9a3fd67e-3332-4e4f-bd35-fd48341b5a4a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.238113 Sep 19 10:37:14.469877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 65/125] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:14 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:15.255975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:15.256581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.263399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.263762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.264829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.266120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.266724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.267289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.336700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ac17aa-a40b-4a79-a109-8939ff3b67f5"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:15.348447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.359251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.391690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.391690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.391690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.391690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.392767 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.460092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:15.468627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4a236e5b-4501-499d-a40c-9b5d386ad7b7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1556 microversion: 2.1 time: 0.216357 Sep 19 10:37:15.473718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 61/126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:15 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1556 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:15.479962 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:15.481006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.490629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.491046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.491515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.492298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.492744 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.493192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.628331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:15.636577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e34049af-acf6-4753-aa60-3d396803ba80 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1549 microversion: 2.1 time: 0.161427 Sep 19 10:37:15.649319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 62/127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:15 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:15.660433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:15.661033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.667152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.667642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.668082 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.668780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.669263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.669686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.808494 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:15.822149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:15.823848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:15.829419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-088a7a58-d474-48b7-a419-42d0421c10b3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.174873 Sep 19 10:37:15.829419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 63/128] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:15 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:15.830850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:15.831373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.837306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.837818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.838253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.838934 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.839392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.840007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.964115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-35b26f75-04b6-468c-a514-8ae38fe63b45 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137122 Sep 19 10:37:15.964792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 64/129] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:37:15 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:15.970834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:15.971679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:15.980137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.980615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.981051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:15.982086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:15.982700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:15.988901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:16.097370 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-90ea4222-a3ba-4d22-b478-601038d8181d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131183 Sep 19 10:37:16.098628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 65/130] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:37:15 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:16.851314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:16.852523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:16.867746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:16.868330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:16.868799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:16.870055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:16.870991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:16.871569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:17.166322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:17.169792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:17.177812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:17.182794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:17.184031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f947ae81-c21e-4f5c-b07e-201c5d27aaf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.336961 Sep 19 10:37:17.192676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 66/131] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:16 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:37:17.786732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e7407bb-0aa4-4535-8b17-e90cd88cf96d", "tag": "46456a98-39a8-4dce-9255-b1a67d65e7e9"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:17.796711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:17.797215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:17.797956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:17.811138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] Creating event network-changed:46456a98-39a8-4dce-9255-b1a67d65e7e9 for instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d on hv-cinder-85827 Sep 19 10:37:17.816527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-ca16a215-3fc0-46ab-a6fc-d75d4bc1cbf5 req-cf4cd725-0160-4f5c-955f-8c219eaddca6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033835 Sep 19 10:37:17.817540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 67/132] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:17.824580 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa2a3428-631d-490f-8f6b-23b4a1b0c30e", "tag": "30e156f6-3b5b-49b1-b29a-66c1049d478b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:17.835955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:17.835955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:17.835955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:17.846499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] Creating event network-changed:30e156f6-3b5b-49b1-b29a-66c1049d478b for instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e on hv-cinder-85827 Sep 19 10:37:17.851318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-b0c5b1d0-1f9f-4e15-b82c-22d22e93bf18 req-9f90d28b-63fb-4583-8a51-982ac4649e96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032298 Sep 19 10:37:17.855835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 68/133] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:18.221083 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:18.221849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:18.238541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:18.240463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:18.241236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:18.245699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:18.247649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:18.248721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:18.662337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:18.672830 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:18.681190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:18.681190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bedf93df-b508-4fb0-ad4f-35bb7734dc09 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.459232 Sep 19 10:37:18.681190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 69/134] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:18 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:37:19.350944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-809246c8-1ecf-4b52-8f2b-7d8dc2008e59 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "POST /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.018667 Sep 19 10:37:19.355167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 66/135] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:37:15 2022] POST /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c/os-volume_attachments => generated 194 bytes in 4021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:19.701600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:19.702781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:19.710621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:19.711430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:19.712131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:19.713507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:19.714118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:19.714708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:19.861535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:19.870194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:19.871631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:19.872739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4be6ec91-45dd-420d-a1f5-ecf18dffb9d2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1406 microversion: 2.20 time: 0.176418 Sep 19 10:37:19.873342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 70/136] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:19 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:20.902540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:20.903382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:20.909714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:20.910276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:20.910721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:20.911410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:20.911858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:20.912287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:21.055443 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:21.063473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:21.064953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:21.066128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-75c7b0bd-66cf-4fe9-beec-210e0e1f99ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1599 microversion: 2.20 time: 0.168946 Sep 19 10:37:21.066913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 67/137] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:37:20 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:37:21.092787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:21.093371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:21.099254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:21.099730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:21.100165 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:21.100909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:21.101443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:21.101868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:21.178247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5bd632c6-3f97-44f8-ba5c-568cd31d7f28 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089314 Sep 19 10:37:21.178845 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 71/138] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Sep 19 10:37:21 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:37:22.444188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:22.449910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:22.450500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:22.451035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:22.463064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] Creating event network-changed:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:37:22.468182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-f26a75d1-35b9-48ca-88ac-3792f8b149f1 req-d46ac817-4e5a-4a25-89be-d7d9cbdef7fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036367 Sep 19 10:37:22.468993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 68/139] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:37:30.421426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:30.422035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:30.423932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=95 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:30.428743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:30.429501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:30.429986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:30.430709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:30.431468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:30.432080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:30.463282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:37:30.833045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-26ff5b57-ba62-4db0-8512-4d72232195a8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 204 len: 0 microversion: 2.1 time: 0.415956 Sep 19 10:37:30.835077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 72/140] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:37:30 2022] DELETE /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:37:30.844660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:30.846203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:30.848352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=63 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:30.854653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:30.855147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:30.855579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:30.856287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:30.856819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:30.860187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:30.905231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:31.034714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:31.043763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ee1f77a6-0018-4b71-9b3c-75513012a7e6 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1553 microversion: 2.1 time: 0.203951 Sep 19 10:37:31.044402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 69/141] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:30 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:32.068351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:32.069086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:32.080530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:32.080530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:32.080858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:32.082140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:32.082602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:32.083040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:32.232824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:32.242178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8c595487-26c8-4cd4-9e98-cf8cb2b8eace tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1553 microversion: 2.1 time: 0.178069 Sep 19 10:37:32.242756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 73/142] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:32 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:33.265563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:33.266217 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:33.275552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:33.276053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:33.276503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:33.277246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:33.277710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:33.278138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:33.419218 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:33.430212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-95f2cd25-2a40-40c8-a442-666031780318 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1553 microversion: 2.1 time: 0.168162 Sep 19 10:37:33.430987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 70/143] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:33 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:34.272401 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cd7fc03-1a62-4bae-a090-83b98557ca2c", "name": "network-vif-deleted", "tag": "ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:34.278447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:34.278925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:34.279369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:34.295268 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] Creating event network-vif-deleted:ba3a19e1-c84d-4bca-8ee6-788bbd9a0c85 for instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c on hv-cinder-85827 Sep 19 10:37:34.300738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-e9f620b6-2626-4236-bbb0-13492cd186cb req-c23c9453-8fb5-4fa0-a1a9-c9dcd2cc1903 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036421 Sep 19 10:37:34.303351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 74/144] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:37:34.454270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:34.455006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:34.483591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:34.484106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:34.485626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:34.485626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:34.485823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:34.486235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:34.577482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:34.586199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-293e623b-d086-4aa9-a005-e5f4dc76b091 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1344 microversion: 2.1 time: 0.136382 Sep 19 10:37:34.595413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 71/145] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:34 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:35.610560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:35.617145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:35.617595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:35.618103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:35.618657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:35.619644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:35.620107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:35.620530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:35.653428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:35.654149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:35.654751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:35.657205 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lazy-loading 'fault' on Instance uuid 0cd7fc03-1a62-4bae-a090-83b98557ca2c {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:37:35.728836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fecaefd115842fe80009d70921c3806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a48df5556fc247fba5eaf7d3d1ecf44f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:35.740803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-94e49f7d-92ce-4896-ba15-e8239f3be327 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 200 len: 1349 microversion: 2.1 time: 0.130758 Sep 19 10:37:35.741868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 75/146] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:35 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 1349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:36.777290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:36.778101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:36.786753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:36.787666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:36.788481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:36.790344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:36.791186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:36.791832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:36.827139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] HTTP exception thrown: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Request method failure captured: Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c HTTP/1.1 Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEY0RgIRdVgaNL5F1h8o723ef2d1IcOdbyvHBRKfanzLniSIKCioBO2_-KdDzYmpQA-FOffOmqkFaLE09G8wcMrs2d9_rEDFb0hNE87LqHfQEOYkgJqLOzWdLoh9ClogqjMEZ8O6DsrV1CtU-6yP54kIdZ7HwkLU4tZcpctVA4WYpvc Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:37:36.832901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a48df5556fc247fba5eaf7d3d1ecf44f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}] Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 5fecaefd115842fe80009d70921c3806 Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.834205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '0cd7fc03-1a62-4bae-a090-83b98557ca2c'} Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:37:36.835482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.837241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.839979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Returning 404 to user: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:37:36.839979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f4f2a7fd-e3ab-46a6-9456-e29c1e79481b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 404 len: 111 microversion: 2.1 time: 0.065399 Sep 19 10:37:36.839979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 72/147] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:36 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:37:36.963780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:36.966080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:36.973515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:36.974138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:36.974795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:36.975632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:36.976405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:36.977077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:36.991535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] HTTP exception thrown: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Request method failure captured: Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c/os-volume_attachments HTTP/1.1 Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEY0RgIRdVgaNL5F1h8o723ef2d1IcOdbyvHBRKfanzLniSIKCioBO2_-KdDzYmpQA-FOffOmqkFaLE09G8wcMrs2d9_rEDFb0hNE87LqHfQEOYkgJqLOzWdLoh9ClogqjMEZ8O6DsrV1CtU-6yP54kIdZ7HwkLU4tZcpctVA4WYpvc Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:37:36.997813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a48df5556fc247fba5eaf7d3d1ecf44f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}] Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 5fecaefd115842fe80009d70921c3806 Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.998949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'server_id': '0cd7fc03-1a62-4bae-a090-83b98557ca2c'} Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:37:36.999793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:37.001316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:37.002922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Returning 404 to user: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:37:37.002922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fb98db69-d3f0-4c7f-898e-42804c783c0b tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040599 Sep 19 10:37:37.002922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:37:36 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:37:38.441714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:38.441714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:38.447190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:38.447676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:38.448123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:38.448823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:38.449524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:38.450344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:38.466432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] HTTP exception thrown: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Request method failure captured: Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c HTTP/1.1 Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEY0RgIRdVgaNL5F1h8o723ef2d1IcOdbyvHBRKfanzLniSIKCioBO2_-KdDzYmpQA-FOffOmqkFaLE09G8wcMrs2d9_rEDFb0hNE87LqHfQEOYkgJqLOzWdLoh9ClogqjMEZ8O6DsrV1CtU-6yP54kIdZ7HwkLU4tZcpctVA4WYpvc Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:37:38.468019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a48df5556fc247fba5eaf7d3d1ecf44f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}] Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 5fecaefd115842fe80009d70921c3806 Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.469219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '0cd7fc03-1a62-4bae-a090-83b98557ca2c'} Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:37:38.470020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.472176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.477052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Returning 404 to user: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:37:38.477052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1589d781-0ba8-4e9a-897c-9c954d09b162 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 404 len: 111 microversion: 2.1 time: 0.034523 Sep 19 10:37:38.477052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 73/149] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:37:38 2022] DELETE /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:37:38.478218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:38.478840 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] [instance: 0cd7fc03-1a62-4bae-a090-83b98557ca2c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:38.491960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:38.493108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:38.493543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:38.494484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:38.495017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:38.495565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:38.511426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] HTTP exception thrown: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Request method failure captured: Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c HTTP/1.1 Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEY0RgIRdVgaNL5F1h8o723ef2d1IcOdbyvHBRKfanzLniSIKCioBO2_-KdDzYmpQA-FOffOmqkFaLE09G8wcMrs2d9_rEDFb0hNE87LqHfQEOYkgJqLOzWdLoh9ClogqjMEZ8O6DsrV1CtU-6yP54kIdZ7HwkLU4tZcpctVA4WYpvc Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:37:38.513597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a48df5556fc247fba5eaf7d3d1ecf44f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a48df5556fc247fba5eaf7d3d1ecf44f"}]}] Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: a48df5556fc247fba5eaf7d3d1ecf44f Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-DeleteServersTestJSON-673885840 Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 5fecaefd115842fe80009d70921c3806 Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-DeleteServersTestJSON-673885840-project Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.515260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '0cd7fc03-1a62-4bae-a090-83b98557ca2c'} Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:37:38.516136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. Sep 19 10:37:38.517550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:37:38.518738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] Returning 404 to user: Instance 0cd7fc03-1a62-4bae-a090-83b98557ca2c could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:37:38.518738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-62173278-c069-4222-8178-f52d5413b1d8 tempest-DeleteServersTestJSON-673885840 tempest-DeleteServersTestJSON-673885840-project] 10.222.0.42 "GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c" status: 404 len: 111 microversion: 2.1 time: 0.041037 Sep 19 10:37:38.519946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:38 2022] GET /compute/v2.1/servers/0cd7fc03-1a62-4bae-a090-83b98557ca2c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:37:50.258330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-840776850", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "networks": [{"uuid": "943a8d7c-3f64-4107-8b34-eb1f0bf5d521"}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:50.285744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=9 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:50.290781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=18 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:50.341679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] validate_networks() for [('943a8d7c-3f64-4107-8b34-eb1f0bf5d521', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:37:50.982662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:37:50.983176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:37:50.983940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:37:50.984557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:37:50.985037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:37:50.996449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:50.997301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:50.997979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:50.999527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:51.000759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:51.002026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:51.027305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Getting quotas for project 90c8dde9309d4f128f53cd6ece43ea52. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:37:51.034798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Getting quotas for user 29ae2fba5ddb4b30a7a8a3ecf10d28bb and project 90c8dde9309d4f128f53cd6ece43ea52. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:37:51.049765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:37:51.053200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:37:51.255764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4c8f540a-83bc-469a-8b65-dcfdb9ef2f37 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004615 Sep 19 10:37:51.257022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 74/151] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:37:51.271987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-494f9e68-2181-40fd-abf0-1c3a69c0e1bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:51.278116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-494f9e68-2181-40fd-abf0-1c3a69c0e1bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:51.282821 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:51.284647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:37:51.444272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-494f9e68-2181-40fd-abf0-1c3a69c0e1bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:51.452539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-494f9e68-2181-40fd-abf0-1c3a69c0e1bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1213 microversion: 2.1 time: 0.186112 Sep 19 10:37:51.456322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 78/152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:51 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:52.494928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8a63a373-21ed-4a35-81c9-9a118f3b70bd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:52.495638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8a63a373-21ed-4a35-81c9-9a118f3b70bd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:52.561142 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8a63a373-21ed-4a35-81c9-9a118f3b70bd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:52.569982 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8a63a373-21ed-4a35-81c9-9a118f3b70bd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1213 microversion: 2.1 time: 0.080686 Sep 19 10:37:52.571203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 75/153] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:52 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:52.745100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1412626048", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:52.800174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] validate_networks() for [('6075686e-fc72-4e07-bc84-884b33c04b1a', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:37:53.341914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:37:53.342343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:37:53.342856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:37:53.343272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:37:53.343696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:37:53.352617 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:53.355680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:53.355680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:53.355680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:53.355680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:53.356109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:53.378202 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:37:53.383049 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for user d3235496c38249a388e4afc263eadbc3 and project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:37:53.394836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:37:53.397371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:37:53.530775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4aaaabf7-1cfd-479c-9e46-6819150f5f99 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.926833 Sep 19 10:37:53.532012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 79/154] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:37:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:37:53.544332 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ef6f009c-ff9b-4b8b-8212-137d9bb7fa0a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:53.545914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ef6f009c-ff9b-4b8b-8212-137d9bb7fa0a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:53.597276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:53.604751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:53.606238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:53.606888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:53.607478 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:53.608303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:53.608884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:53.609579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:53.643553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ef6f009c-ff9b-4b8b-8212-137d9bb7fa0a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:53.651916 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ef6f009c-ff9b-4b8b-8212-137d9bb7fa0a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1222 microversion: 2.1 time: 0.112932 Sep 19 10:37:53.653266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 76/155] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:53 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:53.715787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:53.724137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-032ad935-18a7-4f9e-bdd9-b1d24153e296 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1265 microversion: 2.1 time: 0.131898 Sep 19 10:37:53.727175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 80/156] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:53 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:53.808153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-734042153", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:53.878885 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] validate_networks() for [('6075686e-fc72-4e07-bc84-884b33c04b1a', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:37:54.294106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:37:54.294524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:37:54.295020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:37:54.295591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:37:54.296194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:37:54.305653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:54.306138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:54.306597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:54.307322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:54.307854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:54.308312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:54.332315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:37:54.336946 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for user d3235496c38249a388e4afc263eadbc3 and project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:37:54.348508 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:37:54.352549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:37:54.510297 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a32666a6-260c-44cc-a6cb-afb1a4806d03 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.714210 Sep 19 10:37:54.518873 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 77/157] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:37:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:37:54.530748 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-387d194f-b47c-4f2f-92ff-dd78e8c829df tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:54.531602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-387d194f-b47c-4f2f-92ff-dd78e8c829df tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:54.683381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-387d194f-b47c-4f2f-92ff-dd78e8c829df tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:54.699691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-387d194f-b47c-4f2f-92ff-dd78e8c829df tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1221 microversion: 2.1 time: 0.168589 Sep 19 10:37:54.700330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 81/158] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:54 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:54.750542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:54.751316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:54.767624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:54.769212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:54.770911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:54.776221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:54.777164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:54.777819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:54.998050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:55.025416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-676a013e-d8de-44e6-93c9-c9c864015f9f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1273 microversion: 2.1 time: 0.265089 Sep 19 10:37:55.027666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 78/159] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:54 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:55.734133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7b79d403-ec4a-4441-bddd-092ce41191f8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:55.735446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7b79d403-ec4a-4441-bddd-092ce41191f8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:55.799373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7b79d403-ec4a-4441-bddd-092ce41191f8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:55.807519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7b79d403-ec4a-4441-bddd-092ce41191f8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1221 microversion: 2.1 time: 0.077258 Sep 19 10:37:55.813381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 82/160] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:55 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:56.062554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:56.064898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:56.079647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:56.082472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:56.083158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:56.086486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:56.087237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:56.087904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:56.359431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:56.368608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-93fecc21-a189-4391-990e-0bf80a0083b3 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.313813 Sep 19 10:37:56.370088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 79/161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:56 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:56.832510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:56.834318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:56.846368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:56.848930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:56.849364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:56.853714 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:56.854541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:56.857703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:57.004163 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:57.016752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-823629bf-2c98-4783-a34e-0e5bdf54cd2e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1217 microversion: 2.1 time: 0.189752 Sep 19 10:37:57.017531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 83/162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:56 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:57.169947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31a3045-3311-4cc4-a877-5628ba15015b", "tag": "b87ad1e5-c436-4690-9164-053b928f015f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:37:57.197998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:57.199897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:57.203267 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:57.233743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] Creating event network-changed:b87ad1e5-c436-4690-9164-053b928f015f for instance e31a3045-3311-4cc4-a877-5628ba15015b on hv-cinder-85827 Sep 19 10:37:57.240717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-1dc42fab-fd8f-4ccc-b8f2-3115f85feb35 req-6e017b1f-5b18-4e25-ad95-33d5a2c25562 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075548 Sep 19 10:37:57.242780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 80/163] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:37:57.392888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:57.393556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:57.400781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:57.401309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:57.405879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:57.408144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:57.411553 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:57.412308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:57.812359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:57.821105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1858b537-7b55-4f55-8d16-c1571bc90933 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.432276 Sep 19 10:37:57.821694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 84/164] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:57 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:58.050750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:58.050985 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:58.066271 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:58.066764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:58.067383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:58.068260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:58.068718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:58.071609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:58.169311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:58.177297 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f10dda0f-c5bc-4fc0-9336-8111cb249d38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1273 microversion: 2.1 time: 0.131157 Sep 19 10:37:58.177958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 81/165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:58 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:37:58.843972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:58.844587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:58.854519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:58.855346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:58.855959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:58.856892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:58.857547 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:58.858125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:59.208076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:37:59.208963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:37:59.215898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:59.216559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:59.217148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:59.218112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:37:59.219370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:37:59.220031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:37:59.348852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:59.370462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-778bfeb6-8fa7-46e9-a1c4-197f723b4bf9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1279 microversion: 2.1 time: 0.170733 Sep 19 10:37:59.371656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 82/166] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:59 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:37:59.473716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:37:59.487005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8a4c78f3-5f3e-44d9-829c-f5492e345202 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.647068 Sep 19 10:37:59.503074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 85/167] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:37:58 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:00.398702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:00.400121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:00.407637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:00.408374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:00.409006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:00.409944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:00.410572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:00.411140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:00.510825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:00.511980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:00.518562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:00.519010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:00.519439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:00.520125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:00.520572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:00.520991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:00.728770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:00.743731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c87f2149-57b7-4452-86a9-d698757502bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.235672 Sep 19 10:38:00.744358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 86/168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:00 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:00.746723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:00.758104 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2a2157e3-a412-4b47-a233-04ae09383699 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.364917 Sep 19 10:38:00.760345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 83/169] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:00 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:00.951139 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964df96c-580f-4da3-b3b4-fcc5b7c1079c", "tag": "c6f7c2e0-a7e1-4a33-9473-502c389dcbb0"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:00.961719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:00.962463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:00.963052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:00.976064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] Creating event network-changed:c6f7c2e0-a7e1-4a33-9473-502c389dcbb0 for instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c on hv-cinder-85827 Sep 19 10:38:00.982131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-8b325148-ad62-41a3-857d-fdaee76acfb1 req-daafb1c6-08dc-417d-9563-bc5eacce448a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034731 Sep 19 10:38:00.983307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 87/170] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:01.772722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:01.773608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:01.785822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:01.786568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:01.786680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:01.787414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:01.788641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:01.789872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:01.791533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:01.792350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:01.804369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:01.805834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:01.806468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:01.808381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:01.808877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:01.810369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:02.042374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:02.057260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bf35973b-e3b7-4d7e-8ff4-6a85ce1646a2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.289615 Sep 19 10:38:02.070264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 84/171] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:01 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:02.081170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bba45c57-1e1b-46ed-af10-3dee4b8dad0b", "tag": "6967445f-4780-49ec-86c2-d13683e54272"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:02.095430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:02.096133 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:02.096564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:02.109108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] Creating event network-changed:6967445f-4780-49ec-86c2-d13683e54272 for instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b on hv-cinder-85827 Sep 19 10:38:02.120463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-b3892870-d55b-42f4-9bcc-c902350d0d3d req-34cbb4c5-4ed8-4b05-a463-b439b7f9c5b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048654 Sep 19 10:38:02.121599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 85/172] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:02.572225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:02.580642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3213c63d-4f3e-4bcf-9774-1ec967c6681f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.799194 Sep 19 10:38:02.598394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 88/173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:01 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:03.083910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:03.085723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:03.098271 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:03.098768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:03.099208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:03.099917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:03.100406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:03.100834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:03.278067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:03.292678 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ab3c2926-a635-432e-9fa9-34256e04e33d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.213492 Sep 19 10:38:03.294352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 86/174] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:03 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:03.610087 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:03.610654 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:03.616636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:03.618295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:03.618780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:03.619213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:03.622374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:03.622851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:03.623310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:03.894282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:03.903176 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-912a4aa0-1037-43d1-86ab-c14c419ca330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.297759 Sep 19 10:38:03.903844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 89/175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:03 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:04.315583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:04.316213 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:04.323530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=4 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:04.325795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.326284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.326722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.327487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.327948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.328378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.346557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=16 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:04.519033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:04.527173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7520b19f-f939-45db-b8ab-f3e2231ccdad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.215304 Sep 19 10:38:04.528083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 87/176] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:04 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:04.884041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:04.885183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:04.908303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.908889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.909510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.910270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.910713 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.911131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.927878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:04.929014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:04.936889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.941640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.944569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.947923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:04.954164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:04.954840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:04.967149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5ebfa223-44f9-47ca-b097-c74337b5d220 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/ips" status: 200 len: 149 microversion: 2.1 time: 0.087790 Sep 19 10:38:04.985086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 90/177] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:38:04 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/ips => generated 149 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:04.997394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:04.997892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:05.012450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:05.012926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:05.013386 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:05.015102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:05.015102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:05.015345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:05.068427 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-121898c2-bddb-4f90-bb88-896a9a5015d5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/ips" status: 200 len: 146 microversion: 2.1 time: 0.090336 Sep 19 10:38:05.076245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 91/178] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:38:04 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/ips => generated 146 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:05.288696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:05.297429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-07fddec5-ed06-4a8e-a201-dca245f362ea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.373142 Sep 19 10:38:05.298016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 88/179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:04 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:05.555116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:05.555717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:05.558175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31a3045-3311-4cc4-a877-5628ba15015b", "name": "network-vif-plugged", "status": "completed", "tag": "b87ad1e5-c436-4690-9164-053b928f015f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:05.563459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:05.563973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:05.564402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:05.565114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:05.565565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:05.565983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:05.572011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:05.572503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:05.572940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:05.586268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] Creating event network-vif-plugged:b87ad1e5-c436-4690-9164-053b928f015f for instance e31a3045-3311-4cc4-a877-5628ba15015b on hv-cinder-85827 Sep 19 10:38:05.592487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-ed84a65b-22cd-42c4-8a77-83d8879cce2d req-03809e2e-a00a-411b-bc54-af76b3b60c4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040624 Sep 19 10:38:05.593789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 89/180] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:38:05.765601 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:05.775613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fe18d972-b234-459a-8d17-0b68623ae4af tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.224283 Sep 19 10:38:05.776196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 92/181] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:05 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:06.323591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:06.324448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:06.339572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:06.340478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:06.341227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:06.342163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:06.343046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:06.343631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:06.528507 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:06.537718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0549ed5c-b097-49dc-90a5-135d2c64e057 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.218953 Sep 19 10:38:06.572998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 90/182] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:06 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:06.800266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:06.800881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:06.809406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=12 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:06.813884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:06.814650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:06.815090 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:06.815839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:06.816303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:06.816733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.010276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:07.022402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-00b46a1b-ba66-4bb0-98d6-4ec4f4a8eb12 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1313 microversion: 2.1 time: 0.225691 Sep 19 10:38:07.023674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 93/183] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:06 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:07.560633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:07.562464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:07.570588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:07.571812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:07.572817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.573787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:07.574880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:07.575486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.648618 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba45c57-1e1b-46ed-af10-3dee4b8dad0b", "name": "network-vif-plugged", "status": "completed", "tag": "6967445f-4780-49ec-86c2-d13683e54272"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:07.664901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:07.665530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:07.673106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.688228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] Creating event network-vif-plugged:6967445f-4780-49ec-86c2-d13683e54272 for instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b on hv-cinder-85827 Sep 19 10:38:07.695045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-51875bc4-678c-4441-971d-faedc6eb3082 req-2565ca93-c1c1-4c1d-81c4-8b6b9e57b049 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052979 Sep 19 10:38:07.696435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 94/184] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:38:07.739000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:07.762517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "188c745e-4ac1-4619-aaf3-6bb63dc84f47"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:07.765868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:07.767934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9cc9efd2-9441-4f88-9013-1616d039bea0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.211159 Sep 19 10:38:07.772565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:07 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:07.781184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:07.781714 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:07.782112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.782817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:07.783272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:07.783697 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:07.895123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-139845399", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:07.977624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] validate_networks() for None {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:38:08.574371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:38:08.574945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:38:08.575214 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:38:08.575784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:38:08.576624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:38:08.586315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.587063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.587682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:08.588629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.589480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.590109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:08.608497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Getting quotas for project 993ad6a2ac01432a8d3b64fe272bd874. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:08.612940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Getting quotas for user 0bc8bbdc05484c239d0dc820b95ac664 and project 993ad6a2ac01432a8d3b64fe272bd874. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:08.627063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:38:08.630375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:38:08.793610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4c481d08-1fd9-46fa-8a92-2a60b60b7f59 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906461 Sep 19 10:38:08.800930 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 92/186] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:38:08.826200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:08.859107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:08.867279 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7a7e1669-a980-4787-9eec-de158cfbc9a9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.108929 Sep 19 10:38:08.867906 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 95/187] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:38:07 2022] POST /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:08.871275 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.871807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.872916 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:08.882870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c935841a-7932-4e7f-952e-5bea3a08f6c5"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:08.886538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.888154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.889758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:08.890836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:08.908148 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.914268 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.914903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:08.915941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:08.916551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:08.917164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.140386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:09.149885 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-26a9232a-fdd9-49de-aefc-ed812c74e641 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1497 microversion: 2.1 time: 0.347733 Sep 19 10:38:09.150462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 93/188] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:08 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1497 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:09.155217 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:09.155998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:09.161951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:09.162595 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:09.163239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.163980 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:09.164586 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:09.165010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.316195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:09.324834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6b05394a-a793-4a8b-90bb-777042392c27 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1321 microversion: 2.1 time: 0.173181 Sep 19 10:38:09.337643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 94/189] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:09 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:09.346097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b1799a14-0807-4943-aefb-de7928566b55 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:09.346725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b1799a14-0807-4943-aefb-de7928566b55 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:09.438468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b1799a14-0807-4943-aefb-de7928566b55 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:09.453432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b1799a14-0807-4943-aefb-de7928566b55 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1214 microversion: 2.1 time: 0.114240 Sep 19 10:38:09.458435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 95/190] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:09 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:09.459943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:09.460803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:09.469749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:09.470461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:09.471081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.471943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:09.472561 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:09.473181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.502818 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-921130a5-344c-4886-ac29-f2eb839753c1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/ips" status: 200 len: 153 microversion: 2.20 time: 0.046947 Sep 19 10:38:09.504171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 96/191] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Sep 19 10:38:09 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:38:09.758951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964df96c-580f-4da3-b3b4-fcc5b7c1079c", "name": "network-vif-plugged", "status": "completed", "tag": "c6f7c2e0-a7e1-4a33-9473-502c389dcbb0"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:09.772127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:09.772671 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:09.773182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:09.784379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] Creating event network-vif-plugged:c6f7c2e0-a7e1-4a33-9473-502c389dcbb0 for instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c on hv-cinder-85827 Sep 19 10:38:09.790462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-f9954889-9dfb-4d4a-9b89-c3b6ced06e8c req-4deeffd5-71d7-4f9c-be23-be55584373e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035363 Sep 19 10:38:09.791461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 97/192] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:10.352320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:10.353287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:10.365804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.366638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.367374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.370240 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.370971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.371615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.393666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-51ba869a-0d08-48d2-81e3-31398f8058f1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.517937 Sep 19 10:38:10.402003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 96/193] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:38:08 2022] POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments => generated 194 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:10.419813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:10.481286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:10.482453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:10.502397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.504315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.507519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.508514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.509978 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.512212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.552085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:10.647202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:10.670399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0cae0559-1de3-4924-8b4e-84452fea0717 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1514 microversion: 2.1 time: 0.321748 Sep 19 10:38:10.671554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 98/194] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:10 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:10.694802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:10.704669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:10.706332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-24b45520-2127-410a-a364-c6231c0c0fb4 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1218 microversion: 2.1 time: 0.230860 Sep 19 10:38:10.707347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:10.710721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 97/195] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:10 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1218 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:10.733447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:10.738966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.739860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.740560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.742027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.742682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.744020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.777046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'flavor' on Instance uuid bba45c57-1e1b-46ed-af10-3dee4b8dad0b {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:10.916316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:10.917497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:10.926910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.927800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.928578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.929732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:10.930507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:10.933954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:10.961884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:38:11.283604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e675b827-ccb2-4fcd-9f0e-8b9611774983 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b/action" status: 200 len: 32 microversion: 2.1 time: 0.581695 Sep 19 10:38:11.288676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 99/196] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:38:10 2022] POST /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b/action => generated 32 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 10:38:11.295658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:11.296594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:11.304118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.304972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.305606 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.306613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.307232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.307817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.447803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-28ecf9b1-8650-4553-896d-17e79c09ab29 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 204 len: 0 microversion: 2.1 time: 0.542519 Sep 19 10:38:11.449251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 98/197] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:38:10 2022] DELETE /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:38:11.458625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:11.461425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:11.471670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.472791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.474125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.475763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.477098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.477808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.492117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:11.500619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3fd1d352-8a94-47de-b211-097a0cdbe558 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.209923 Sep 19 10:38:11.508843 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 100/198] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:11 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:11.670666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:11.681486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b4967631-484e-4bc9-8298-9581294b05f4 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1503 microversion: 2.1 time: 0.227349 Sep 19 10:38:11.682379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 99/199] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:11 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:11.737328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:11.737927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:11.744181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.744822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.745206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.745897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:11.746533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:11.746888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:11.849254 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:11.871077 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f41f314b-f238-4559-8f87-e02749785861 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1266 microversion: 2.1 time: 0.136643 Sep 19 10:38:11.872674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 101/200] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:11 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:12.353187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:12.353907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:12.361536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.362226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.362664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.363529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.364018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.365792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.390890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'flavor' on Instance uuid 784aab17-65f2-41da-97ef-e294b0a9713d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:12.525898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:12.530443 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:12.546948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.547443 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.548205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.550645 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.552163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.553302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.743564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:12.753701 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fbb5b55b-f604-4e2e-9207-547660210330 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.233176 Sep 19 10:38:12.754816 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 102/201] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:12 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:12.760588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:12.761504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:12.773797 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.774539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.775938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.778888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:12.779577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:12.780212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:12.998190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.015803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-56f3c695-dc24-442d-93ac-c77f4f2c3931 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1503 microversion: 2.1 time: 0.259389 Sep 19 10:38:13.016585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 103/202] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:12 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:13.024280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:13.025000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:13.043006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.044836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.045237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.046243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.046786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.047319 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.137421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.147559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0abaac51-5b8b-4608-bbf0-3ca22d421aba tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1266 microversion: 2.1 time: 0.129650 Sep 19 10:38:13.148357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 104/203] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:13 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:13.182076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8d506f8e-bac1-4487-afaf-258dc2ea8245 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/action" status: 202 len: 0 microversion: 2.20 time: 0.832789 Sep 19 10:38:13.183711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 100/204] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 19 10:38:12 2022] POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:38:13.191673 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:13.192291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:13.198256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.198948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.199410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.200309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.200765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.201219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.372083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.381401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.382864 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.384053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-604b7213-d98e-43b1-9dbc-569de7f8aafc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.196278 Sep 19 10:38:13.384841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 105/205] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:13 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:13.788100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:13.788803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:13.796212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.796701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.797206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.797946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:13.798515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:13.798835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:13.955426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:13.964230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b1c7ca72-039c-47fc-96f6-cd61a35361c2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.181909 Sep 19 10:38:13.975432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:13 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:14.042043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:14.051306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:14.072264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.078556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.085241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.086417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.087053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.089791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.171520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:14.172328 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:14.178944 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.182038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.182038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.182038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.183615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.184363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.300636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:14.312796 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3bc2ac4e-f564-4cd2-a934-51d46dbb9e37 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1266 microversion: 2.1 time: 0.144964 Sep 19 10:38:14.316591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 102/207] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:14 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:14.410592 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:14.411531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:14.418743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.422012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.428920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.429977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:14.430656 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:14.431295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:14.475480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:14.484199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d23bb0ee-786d-439c-a73e-fc93c0f31041 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1503 microversion: 2.1 time: 0.446765 Sep 19 10:38:14.485530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 106/208] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:14 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1503 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:14.648886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:14.668000 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:14.669515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:14.670702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-232b0140-c8f4-44fd-a754-0993a3d9d9be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.264038 Sep 19 10:38:14.676721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 103/209] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:14 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:14.990827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:14.992325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:15.004211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.004694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.005162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.016940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.024661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.029463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.344158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:15.344824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:15.354196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.355028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.355821 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.356812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.357481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.358092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.510091 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:15.519615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3da6db7e-bb24-4a41-8fa2-c815b6b025bc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1274 microversion: 2.1 time: 0.179662 Sep 19 10:38:15.525844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 104/210] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:15 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:15.530788 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31a3045-3311-4cc4-a877-5628ba15015b", "name": "network-vif-deleted", "tag": "b87ad1e5-c436-4690-9164-053b928f015f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:15.559853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.560727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.561643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.576837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] Creating event network-vif-deleted:b87ad1e5-c436-4690-9164-053b928f015f for instance e31a3045-3311-4cc4-a877-5628ba15015b on hv-cinder-85827 Sep 19 10:38:15.599075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-1bb00207-38b0-41cf-9374-6517467f07f6 req-7b254624-99d4-4cf3-abc1-7fb6b73e19ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071651 Sep 19 10:38:15.602620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 105/211] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:15.611299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:15.612877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:15.626659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.627638 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.628365 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.654102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.654102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.654102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.672137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:15.692280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bed6371f-a87c-47f2-9c09-153b4cb1007a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.708457 Sep 19 10:38:15.698608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 107/212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:14 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:15.698608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:15.698608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:15.746499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.747118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.747567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.759410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:15.759968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:15.766943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:15.829963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:15.845529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-70bd1691-5c1b-45fa-b65c-e92739cd3a35 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1461 microversion: 2.1 time: 0.240371 Sep 19 10:38:15.846863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 106/213] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:15 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1461 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:16.068624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:16.087544 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:16.091672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:16.094085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2e2132f8-c3f8-4579-b4c7-ad26234caf96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.392964 Sep 19 10:38:16.097362 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 108/214] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:15 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:16.547096 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:16.547721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:16.557926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.559266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.560476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.570376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.570376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.570376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.664754 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:16.685159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-67ada383-40e2-4645-9ae4-110518f724bd tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1272 microversion: 2.1 time: 0.137684 Sep 19 10:38:16.689204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 107/215] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:16 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:16.723059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:16.733620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:16.771797 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.772719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.773208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.777748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.778232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.791225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.870896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:16.871622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:16.884251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.884816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.886750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.887493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.890760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.891208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.977265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:16.977956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:16.980246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:16.980246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid e31a3045-3311-4cc4-a877-5628ba15015b {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:17.043652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:17.073351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-319e18b7-4c49-4079-a689-85e40a25ed6b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 200 len: 1303 microversion: 2.1 time: 0.206601 Sep 19 10:38:17.090406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 108/216] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:16 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 1303 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:17.122576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:17.123192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:17.133772 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:17.134319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:17.134691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:17.135384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:17.135836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:17.142671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:17.188556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:17.203972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2c6015f4-b285-4257-b681-8c8781a5ab1d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.481685 Sep 19 10:38:17.205157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 109/217] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:16 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:17.711462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:17.711898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:17.741385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:17.745227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:17.745227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:17.745227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:17.745227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:17.745590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:17.771810 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:17.782124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:17.783567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:17.789649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b0be0384-fef2-493c-9966-3db531ee66cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.671410 Sep 19 10:38:17.790238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 109/218] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:17 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:18.103935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:18.108694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: e31a3045-3311-4cc4-a877-5628ba15015b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:18.131062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:18.133427 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.133979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.134430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:18.139290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.139923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.140388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:18.145079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7085c938-e594-4f4d-a3a9-0b9f70b93f11 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.439938 Sep 19 10:38:18.146604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:17 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:18.171443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] HTTP exception thrown: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Request method failure captured: Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b HTTP/1.1 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEZ8UIF-IZgZJcewXHQgcQ_SSU_Zm3Kp0CByO1m79ChMTsMm-MBpaHqjXpuNA4NQSHj1BBlylN9L8Dw0OPy5X-C3nE3yZGRmdpzOWsqrotVxxCKtwix3XShB_P9uVtDjisYcUXU927X1Wi0tJr1mYZooJprXMGMVMIPmaIfFfImo6AE Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 90c8dde9309d4f128f53cd6ece43ea52 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesActionsTest-1645666641 Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:38:18.173451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90c8dde9309d4f128f53cd6ece43ea52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90c8dde9309d4f128f53cd6ece43ea52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90c8dde9309d4f128f53cd6ece43ea52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90c8dde9309d4f128f53cd6ece43ea52"}]}] Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesActionsTest-1645666641 Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 90c8dde9309d4f128f53cd6ece43ea52 Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesActionsTest-1645666641 Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesActionsTest-1645666641-project Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 29ae2fba5ddb4b30a7a8a3ecf10d28bb Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesActionsTest-1645666641-project Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. Sep 19 10:38:18.174939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'e31a3045-3311-4cc4-a877-5628ba15015b'} Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:38:18.175801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. Sep 19 10:38:18.177314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:18.178606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Returning 404 to user: Instance e31a3045-3311-4cc4-a877-5628ba15015b could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:38:18.178606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-971530cc-5869-4eef-9395-f66d0a5b291e tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b" status: 404 len: 111 microversion: 2.1 time: 0.074806 Sep 19 10:38:18.186112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 110/220] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:18 2022] GET /compute/v2.1/servers/e31a3045-3311-4cc4-a877-5628ba15015b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:38:18.236493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:18.237125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:18.244189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.244684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.245144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:18.245857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.246310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.246733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:18.322594 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2071060138", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "networks": [{"uuid": "943a8d7c-3f64-4107-8b34-eb1f0bf5d521"}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:18.392624 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] validate_networks() for [('943a8d7c-3f64-4107-8b34-eb1f0bf5d521', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:38:18.481484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:18.489779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0a291dd9-bb92-4a27-83be-9b518186e747 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.257091 Sep 19 10:38:18.490363 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 111/221] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:18 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:18.819166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:18.825044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:18.827356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:18.839932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.840436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.840875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:18.841616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:18.842070 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:18.842491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.110823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:38:19.111426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:38:19.113871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:38:19.115114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:38:19.115971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:38:19.134445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.134445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.134783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.135724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.136728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.137515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.157592 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:19.186373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Getting quotas for project 90c8dde9309d4f128f53cd6ece43ea52. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:19.193009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Getting quotas for user 29ae2fba5ddb4b30a7a8a3ecf10d28bb and project 90c8dde9309d4f128f53cd6ece43ea52. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:19.218745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:38:19.221307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:38:19.358079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.358079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.358746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.358746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5dc7995e-2337-44e2-bf82-f24bd59327e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.539545 Sep 19 10:38:19.358746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 112/222] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:18 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:19.360721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:19.361740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:19.367907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.368486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.369001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.369791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.370311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.370802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.375197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:19.447713 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=8 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:19.506546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.514492 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1e764d30-3fbc-40d3-b1f3-c9e5f326479a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.157984 Sep 19 10:38:19.534121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 113/223] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:19 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:19.539213 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "355dbb41-49a2-4ef6-ac29-2545bf766759", "tag": "1682b614-36cd-4110-b45d-b3d96f12d7b0"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:19.548841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.549350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.549788 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.560684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] Creating event network-changed:1682b614-36cd-4110-b45d-b3d96f12d7b0 for instance 355dbb41-49a2-4ef6-ac29-2545bf766759 on hv-cinder-85827 Sep 19 10:38:19.565532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-77193058-cf8d-4a71-b009-8f3a3036f1b8 req-477b5fac-fd78-4a5a-bcc6-28257b8ef8cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048837 Sep 19 10:38:19.566126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 114/224] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:19.571702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:19.572394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:19.578399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.578881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.579319 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.580005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:19.580461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:19.581020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:19.688121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9bf5a255-848a-4223-8d03-259ab7dc0229 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.369259 Sep 19 10:38:19.703089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 111/225] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:38:19.703089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b6c39e40-79c3-46b2-b84d-047bfcda465b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:19.703089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b6c39e40-79c3-46b2-b84d-047bfcda465b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:19.768350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b6c39e40-79c3-46b2-b84d-047bfcda465b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.779991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b6c39e40-79c3-46b2-b84d-047bfcda465b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1214 microversion: 2.1 time: 0.082004 Sep 19 10:38:19.786325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 112/226] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:19 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:19.803523 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:19.812429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8ef02da0-9c59-4568-ba28-342e3344c9f7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.245004 Sep 19 10:38:19.813004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 115/227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:19 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:20.382670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:20.383450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:20.398082 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.399235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.399781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.400811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.403951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.407130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.418375 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:20.553355 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:20.554688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:20.572402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.574556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.574882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:20.575788 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.577724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.579008 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.580145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.585595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:20.587194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:20.588643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-da6f427a-c544-433b-bb08-f4199a5a5f4e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.210491 Sep 19 10:38:20.601923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 113/228] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:20 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:20.805141 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:20.807463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:20.815101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.816117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.817459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.823134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:20.827180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.828075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.828744 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.831105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bcce915d-ca22-48b6-bf04-3aed9634b178 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.283149 Sep 19 10:38:20.831694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 116/229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:20 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:20.847483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:20.849473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:20.858145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.858771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.860273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.861290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:20.861870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:20.862480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:20.923973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:20.939600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a4357b19-7a35-400b-8321-4511a3efe1cd tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1218 microversion: 2.1 time: 0.139405 Sep 19 10:38:20.955794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 114/230] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:20 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:21.061075 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:21.070840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-04ea60ed-b67c-4a47-8542-8c19e713b027 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.234353 Sep 19 10:38:21.071579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 117/231] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:20 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:21.383186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-251d2906-dc56-4436-b6b3-a334060076ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: .version_select at 0x7fb943655820>, body: {"keypair": {"name": "tempest-keypair-1208075752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGu9NH6xVo0cdlB74JlIBy8IO2x9cPiboT8NqtvzGnO/fmAm+m8Z7x2JLPglrQ6ze/7EsDK4WMPrb6MKIde6IM5/XS7fozKV9G7+gfCSBaOid0MRVgRTVKSCKzLKwixYg=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:21.401268 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-251d2906-dc56-4436-b6b3-a334060076ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:21.407887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-251d2906-dc56-4436-b6b3-a334060076ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:21.485078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-251d2906-dc56-4436-b6b3-a334060076ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106316 Sep 19 10:38:21.486288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 115/232] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:38:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:21.616054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:21.616829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:21.627363 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.628014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.628547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:21.629521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.630619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.631156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:21.813114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:21.829643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:21.831123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:21.834349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-55796079-679f-4831-b501-332e8d375a26 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.221923 Sep 19 10:38:21.850014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 118/233] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:21 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:21.869478 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:21.870127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:21.882402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.882905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.884161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:21.885072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.885701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.886448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:21.964444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:21.965276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:21.975384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.978565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.979260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:21.981938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:21.982615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:21.984246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:22.045618 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:22.058286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-93a1fd23-6581-40cd-a3e6-608251c33cd2 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.203467 Sep 19 10:38:22.061558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 116/234] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:21 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:22.071903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:22.094221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:22.095106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:22.097429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c720210e-9785-47ed-ad2e-906c30659856 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1218 microversion: 2.1 time: 0.126074 Sep 19 10:38:22.113566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 119/235] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:21 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:22.119028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:22.119555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:22.120000 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:22.120718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:22.121204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:22.121633 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:22.282313 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:22.291280 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c264d0cb-4d9b-44cf-8244-378e649c2a3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.201962 Sep 19 10:38:22.292103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 117/236] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:22 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:22.862087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:22.862626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:22.869601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:22.870092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:22.870531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:22.871231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:22.871691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:22.872132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.023913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.043344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.044909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.046221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f6cef0f7-7a60-4c4e-8c04-95e9b95f97d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.188833 Sep 19 10:38:23.046825 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 120/237] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:22 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:23.087678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:23.088498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:23.095626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.096104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.096534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.097255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.097707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.098131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.121216 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:23.121713 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:23.127623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.128113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.128631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.129374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.129833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.131109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.243755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.254380 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a21c7ec6-0037-4c1d-a7e8-f168086a2342 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1266 microversion: 2.1 time: 0.136671 Sep 19 10:38:23.255446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:23 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:23.299908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.310827 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f1561a4-edef-4f6c-8bbc-4753fc904fed tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.226810 Sep 19 10:38:23.310827 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 118/239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:23 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:23.332127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:23.332812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:23.339924 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.348026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.348783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.349753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:23.350477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:23.351178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:23.573790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:23.582242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-21e5f15a-786d-4408-8500-2a0486da441c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.255765 Sep 19 10:38:23.582918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 122/240] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:23 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:24.074423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:24.075211 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:24.088363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.088996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.089540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.091735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.093589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.094334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.277603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.287335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:24.290026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:24.296511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.297481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.297627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.298291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.299116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.299288 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.299602 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.300031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.300959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f795aa75-c119-49ab-80fa-ed9459fbe55d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.230879 Sep 19 10:38:24.302204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 119/241] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:24 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:24.339363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:24.340850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:24.361980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.364407 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.365050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.365965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.366709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.367463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.388950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.401496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-87cc13d3-9d58-40b4-a248-65418d91b521 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1272 microversion: 2.1 time: 0.119657 Sep 19 10:38:24.402577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 123/242] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:24 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:24.541283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.551912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0f33be98-8762-4b26-812e-76449e5c117f tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.216741 Sep 19 10:38:24.561111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 120/243] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:24 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:24.606009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:24.606619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:24.613515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.613972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.614448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.615170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:24.615688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:24.616053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:24.850807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:24.862314 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8069f04a-03ea-4cc5-977a-900c2e2e502a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.259639 Sep 19 10:38:24.866007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 124/244] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:24 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:25.298034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1939911690", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c"}], "security_groups": [{"name": "tempest-securitygroup--1181683631"}], "key_name": "tempest-keypair-1208075752", "user_data": "}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:25.332606 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:25.339149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:25.349450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:25.349450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:25.349450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:25.359448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:25.360548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:25.361000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:25.469988 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] validate_networks() for [('9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:38:25.559938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:25.583731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:25.584948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:25.586229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-18e7dbbf-d362-4dc0-b384-3aa73c93d72b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.258779 Sep 19 10:38:25.593176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 125/245] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:25 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:25.593176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:25.593176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:25.609079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:25.610609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:25.611283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:25.612270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:25.612872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:25.613651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.008193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.021756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d4ece737-4a1f-4790-a587-7d0356bdd7b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.433569 Sep 19 10:38:26.033374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 126/246] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:25 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:26.033374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:26.033374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:26.049424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.049913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.050362 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.051078 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.052189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.052487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.074226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:38:26.075039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:38:26.075649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:38:26.076187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:38:26.076850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:38:26.087468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.088294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.088954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.089940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.091216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.091878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.113340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:26.126851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:26.143861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:38:26.149342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:38:26.318890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-515fa4c1-d821-4a1c-baed-062eafaf74c2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.025460 Sep 19 10:38:26.320966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 121/247] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:38:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:38:26.330564 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:26.333658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:26.339256 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.340092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.341226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.342705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.343534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.344248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.455336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.463628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6ee7ea08-ec35-4f56-8645-5c2283934ea1 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.440258 Sep 19 10:38:26.464214 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 127/248] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:26 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:26.484441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-63fefbef-12a3-4bbd-b94a-4269b0790690 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:26.484441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-63fefbef-12a3-4bbd-b94a-4269b0790690 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:26.542431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.547338 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-668f5f57-3a47-46cf-9067-f6a2e1313c9d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.224548 Sep 19 10:38:26.548056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 122/249] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:26 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:26.570860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-63fefbef-12a3-4bbd-b94a-4269b0790690 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.579693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-63fefbef-12a3-4bbd-b94a-4269b0790690 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1242 microversion: 2.1 time: 0.101437 Sep 19 10:38:26.580459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 128/250] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:26 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:26.614796 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:26.614986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:26.622620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.623042 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.623568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.624277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:26.624736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:26.625196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:26.841858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.855833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.857904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:26.864752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-de73da60-1ada-40c3-b9d2-eb00e5162247 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.251277 Sep 19 10:38:26.864752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 123/251] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:26 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:27.046245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:27.046936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:27.065700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.066208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.066660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.067505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.068037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.068392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.335394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:27.346085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-87979888-4177-4322-8402-70476094e95c tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.303428 Sep 19 10:38:27.346877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 129/252] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:27 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:27.435243 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635cf75e-34c5-41a9-8c5f-39b4a844f223", "tag": "d6a0b5a8-2285-47d9-8f57-c4ec2f91335c"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:27.452683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.455993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.456866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.483400 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "355dbb41-49a2-4ef6-ac29-2545bf766759", "name": "network-vif-plugged", "status": "completed", "tag": "1682b614-36cd-4110-b45d-b3d96f12d7b0"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:27.503720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.504217 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.504811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.526366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] Creating event network-vif-plugged:1682b614-36cd-4110-b45d-b3d96f12d7b0 for instance 355dbb41-49a2-4ef6-ac29-2545bf766759 on hv-cinder-85827 Sep 19 10:38:27.532223 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] Creating event network-changed:d6a0b5a8-2285-47d9-8f57-c4ec2f91335c for instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 on hv-cinder-85827 Sep 19 10:38:27.543469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-50888d0f-d597-4c95-8730-3f9f2087500b req-0cb453df-1b4e-49de-be75-4d2d1e52b34f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057982 Sep 19 10:38:27.543933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-d62be057-efbf-4251-8cb5-0a7cecaa109e req-59cc4096-10d3-4ddf-9d9d-6f72d00c3c9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106932 Sep 19 10:38:27.543933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 124/253] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:27.544265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 130/254] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:27.546843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:27.547685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:27.554501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.555189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.555700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.556416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.559533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.559992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.575475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:27.576417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:27.595993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.596764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.597446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.598438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.599053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.599645 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.857048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:27.857048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e6f0c3ac-bb5c-4cb5-a01e-42b3b63c004a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.209686 Sep 19 10:38:27.857048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 125/255] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:27 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:27.857048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:27.858299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:27.858299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.858299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.858299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.858732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.858732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.858732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.859069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:27.859069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-902b71ac-222b-4010-9108-1802b9f7a9e6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.254414 Sep 19 10:38:27.859069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 131/256] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:27 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:27.859600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:27.859600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-be5b8044-e6d8-4bef-8030-fd72dc50a204 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1246 microversion: 2.1 time: 0.084409 Sep 19 10:38:27.859600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 126/257] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:27 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:27.898509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:27.909109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:27.913325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.913325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.913325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.913325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:27.913791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:27.913791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:27.920333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:28.072986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:28.072986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:28.073387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:28.073387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b57679ee-c7a5-46d3-983d-00dee0a478bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.177694 Sep 19 10:38:28.073387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 132/258] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:27 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:28.369280 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:28.371524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:28.377419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.377890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.378318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:28.378990 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.379437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.380344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:28.558647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:28.563608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8f8149b1-5d4b-4220-8a96-423705082108 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.198223 Sep 19 10:38:28.564365 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 127/259] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:28 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:28.892690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:28.893290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:28.893484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:28.893571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:28.903643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.904145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.904592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:28.905349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.905788 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.910176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:28.911429 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.911995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.912441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:28.916235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:28.916711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:28.917162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.016959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.030789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4b93b201-3dac-47c4-ba1d-a3f336af51d2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1238 microversion: 2.1 time: 0.142844 Sep 19 10:38:29.031372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 128/260] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:28 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1238 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:29.052632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:29.053269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:29.059702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.060186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.060667 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.061391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.062525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.062992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.219780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.229292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f9b4c137-86d4-4ad1-8094-d719db3f776c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.185836 Sep 19 10:38:29.229878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 129/261] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:29 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:29.252577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:29.253234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:29.269374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.269865 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.271059 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.271765 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.274070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.274499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.420746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.431464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1b30485b-ff95-483d-b567-7a66d119d25a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.544355 Sep 19 10:38:29.432264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 133/262] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:28 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:29.514994 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:29.521403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.521920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.522519 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.588890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Going to try to stop instance {{(pid=127497) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 10:38:29.685459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.700166 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.701690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.702945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d0105313-f3ad-4e9f-9d52-fcb1cc92710a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.456645 Sep 19 10:38:29.703532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 130/263] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:29 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:29.708495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:29.712579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:29.715321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.715806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.716349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.717035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.717513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.717963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.802300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2522ea4c-89c6-4850-89c8-3c33aca506b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.291458 Sep 19 10:38:29.803107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 134/264] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:38:29 2022] POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:38:29.808687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fc8b90a5-b205-4178-800d-fd12d0fea343 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'create', calling method: .version_select at 0x7fb9433b5dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1485628078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbLdtvzAHxIpltn6p7DnPvbP0w0RDyHU3OGcqj3mP2r1SjWLgJiPI53pbJzdBFOQQM2wIcGcvdCScx+p6/6zVqpe0s8ba65wCXAyEWJ9yrMxiUiusQGSA0BgY1mJqDs1Q=="}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:29.825441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-fc8b90a5-b205-4178-800d-fd12d0fea343 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Getting quotas for project c84c95680abc4f28b49cd092ca96fe32. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:29.829372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-fc8b90a5-b205-4178-800d-fd12d0fea343 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Getting quotas for user 0b3fcdf3a12147f591c0ea67b57c8c7e and project c84c95680abc4f28b49cd092ca96fe32. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:29.852055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:29.858729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2483ce5a-39a3-41ec-9091-67579248d3ad tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.154251 Sep 19 10:38:29.859333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 131/265] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:29 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:29.863780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:29.864441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:29.869903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.870388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.870864 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.871555 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:29.872013 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:29.872439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:29.876714 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:29.929961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fc8b90a5-b205-4178-800d-fd12d0fea343 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.125478 Sep 19 10:38:29.933249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 135/266] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:38:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:30.016554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.025836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ebc8c47b-5530-4004-be27-26102a54f9d6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.165497 Sep 19 10:38:30.026403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 132/267] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:29 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:30.049354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-195992569", "imageRef": "1f1ac6d4-24d1-4784-a25a-1b9c7a0cfc2a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1485628078", "networks": [{"uuid": "b903e8e5-fed9-49fc-8a3e-60d9b259d1cc"}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:30.061095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.066289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.072423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.072920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.073391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.074104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.074598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.118994 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] validate_networks() for [('b903e8e5-fed9-49fc-8a3e-60d9b259d1cc', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:38:30.148461 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.155380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-85f27d5c-a224-4c26-a7fb-4f57a95f0e18 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1238 microversion: 2.1 time: 0.100629 Sep 19 10:38:30.155956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 133/268] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:30.259840 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.260541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.267138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.267626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.268060 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.268779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.269264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.273655 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.405021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.412986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d7623076-f150-462f-aa77-f58119ab19a7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.156923 Sep 19 10:38:30.423171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 134/269] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:30.456091 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.456688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.463362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.463848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.464283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.464975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.465460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.465887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.515230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:38:30.515664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:38:30.516138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:38:30.516549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:38:30.516963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:38:30.526690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.527175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.531799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.531799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.531799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.531799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.547280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Getting quotas for project c84c95680abc4f28b49cd092ca96fe32. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:38:30.552118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Getting quotas for user 0b3fcdf3a12147f591c0ea67b57c8c7e and project c84c95680abc4f28b49cd092ca96fe32. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:38:30.563342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:38:30.565761 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1f1ac6d4-24d1-4784-a25a-1b9c7a0cfc2a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:38:30.578206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:30.610189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.618791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-07b0f35a-37c8-4168-8596-26e6310186a9 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1314 microversion: 2.1 time: 0.166563 Sep 19 10:38:30.620399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 135/270] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:30.718609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-15719d49-8142-4fa9-b6f8-a8563286d105 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674262 Sep 19 10:38:30.719187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 136/271] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:38:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:38:30.730789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5fc944f5-bced-415c-9be5-9524ccc04fc9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.735359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.735359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.737752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5fc944f5-bced-415c-9be5-9524ccc04fc9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.753513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.754014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.754464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.755170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.755629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.756545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.795635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5fc944f5-bced-415c-9be5-9524ccc04fc9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.803726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5fc944f5-bced-415c-9be5-9524ccc04fc9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1258 microversion: 2.1 time: 0.076812 Sep 19 10:38:30.805408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 136/272] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:30.882207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:30.887676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:30.890356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.890992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.891665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.892770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:30.893430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:30.894108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:30.966287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.983798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.985584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:30.986882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-925ec7d9-d529-4520-83c5-b1da3f2316a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1745 microversion: 2.20 time: 0.257644 Sep 19 10:38:30.987781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 137/273] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:31.032510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.040768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2c89a3f6-c454-4f21-92e6-3b2a999ec282 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.163000 Sep 19 10:38:31.041667 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 137/274] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:30 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:31.049881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.050496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.056513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.057028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.057493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.058181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.058638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.059068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.178012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.178621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.185559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.186055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.186497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.187201 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.187659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.188117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.188379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.197933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c9a0b9b8-e008-48a3-b411-16fe518ac026 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.151812 Sep 19 10:38:31.198932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 138/275] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:31 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:31.260432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.268939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7d737ba2-5cd0-4d79-8a58-d652234848e6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1238 microversion: 2.1 time: 0.094744 Sep 19 10:38:31.269572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 138/276] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:31 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:31.438196 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.438575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.445081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.445852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.446295 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.447161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.447625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.448053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.587841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.596356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-42287330-c0ac-4125-b282-3313eebc2d59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.162853 Sep 19 10:38:31.597265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 139/277] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:31 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:31.642245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.642860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.650050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.650677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.651220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.652042 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.652569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.653198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.783442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.791132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3c577ee7-ef7d-421b-80a5-2a330ed78ddc tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1463 microversion: 2.1 time: 0.153023 Sep 19 10:38:31.792019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 139/278] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:31 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:31.826208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3708cf82-843b-43d8-91e5-ecb4281776c5 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.826973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3708cf82-843b-43d8-91e5-ecb4281776c5 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.846975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:31.847466 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:31.853594 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.854073 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.854502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.855184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:31.855635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:31.856057 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:31.881194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3708cf82-843b-43d8-91e5-ecb4281776c5 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:31.883621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:38:31.888733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3708cf82-843b-43d8-91e5-ecb4281776c5 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1258 microversion: 2.1 time: 0.067087 Sep 19 10:38:31.891650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 140/279] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:31 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.012474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.013404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.020408 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.020896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.021374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.022067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.022525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.023097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.068725 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:32.151183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.158723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6a680055-8f5a-46f2-8465-0b8eda84f1e5 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "DELETE /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 204 len: 0 microversion: 2.1 time: 0.315325 Sep 19 10:38:32.159313 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 140/280] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:38:31 2022] DELETE /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:38:32.159474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.161552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.162730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-24f607f9-8619-4ea0-956f-f978b4b27284 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1745 microversion: 2.20 time: 0.154204 Sep 19 10:38:32.163420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 141/281] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:32.165106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.165820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.167662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.169302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.172107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.172398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.172863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.173604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.174042 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.174461 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.177280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.177829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.178334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.179168 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.179696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.180192 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.306825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.313838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.314324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-49cbd38a-20b0-4b89-8f07-d1ce0f940886 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.153898 Sep 19 10:38:32.315090 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 141/282] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.319752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.320281 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.321571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-04e32bb1-ab67-44c5-8219-aecc3fb10709 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1469 microversion: 2.1 time: 0.157335 Sep 19 10:38:32.322136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 142/283] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.326663 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.327452 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.328838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.329418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.329911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.330604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.331054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.331477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.339209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.339917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.340431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.341231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.341760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.342259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.403883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.412162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cbac71aa-c303-4f86-96c3-60bce0ce9ead tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1294 microversion: 2.1 time: 0.088924 Sep 19 10:38:32.412877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 143/284] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.462771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.470987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1a2f32c0-44af-44cd-8564-defa55729606 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.155093 Sep 19 10:38:32.476061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 142/285] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.619343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.619996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.626056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.626541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.626980 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.627670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.628129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.628556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.757803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.767539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-98c9cd7f-4900-4b99-b9cb-5c43d4fe5a9e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.152102 Sep 19 10:38:32.768119 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 144/286] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:32.911666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:32.912270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:32.919002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.919482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.919907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.920587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:32.921029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:32.921487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:32.981646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:32.989002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-35382070-2f4d-42f2-8a18-61459ee89664 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1262 microversion: 2.1 time: 0.081305 Sep 19 10:38:32.989586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 143/287] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:32 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:33.187943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.188559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.195557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.196044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.196483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.197270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.197729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.198960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.333490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.338398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.339548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.343844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.345465 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.346711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7fc62201-5194-4cef-b5f9-d61e647c98cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1745 microversion: 2.20 time: 0.162762 Sep 19 10:38:33.347696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.347830 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 145/288] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:33.352920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.355930 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.361373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.362138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.362345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.362910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.363046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.364398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.364827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.365774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.366350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.370056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.370630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.516703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.525148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c45b8dc8-855f-4af5-bfdf-f2607bc345fe tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1469 microversion: 2.1 time: 0.176588 Sep 19 10:38:33.525815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 146/289] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:33.530606 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.531286 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.533132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.541726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a067a135-ddcf-49a8-86d4-b3fb9a3c4f0f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.207931 Sep 19 10:38:33.542288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 144/290] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:33.545939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.557206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.557353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "name": "network-vif-plugged", "status": "completed", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:33.557461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.557461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.557461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.557461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.557743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.557743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.557743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.570910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] Creating event network-vif-plugged:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:38:33.577263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-b2d91122-8f0e-4afc-b924-5df1fc670de7 req-5188dfb5-1e84-4603-82bf-1d314b6fb58f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033763 Sep 19 10:38:33.578169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 145/291] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:33.583740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.584446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.591032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.595783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.595783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.595783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.595783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.596724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.616033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.623855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-440f3c11-70f1-4568-97a8-8463b03fe3b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1294 microversion: 2.1 time: 0.096910 Sep 19 10:38:33.624673 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 147/292] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:33.726079 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.734159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cc00f00c-6791-4891-9ee7-948a2397ef94 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.154919 Sep 19 10:38:33.734721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 146/293] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:33.791395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:33.792125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:33.798016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.798499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.798935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.799617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:33.800068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:33.800489 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:33.930062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:33.937668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-86669f65-7091-480c-9e95-0058d44c5814 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.150129 Sep 19 10:38:33.938239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 148/294] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:33 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:34.011071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.011606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.018326 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.018806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.019242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.020428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.020883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.021332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.078692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.086583 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fa7ea982-4948-4897-a4d2-223834843e3a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1262 microversion: 2.1 time: 0.079400 Sep 19 10:38:34.087145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 147/295] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:34.376080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.376628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.383554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.384042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.384485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.385205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.385668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.386100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.512717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.521615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.523074 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.524223 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a8521341-16cb-419e-b1d9-cb813af542bb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1745 microversion: 2.20 time: 0.152372 Sep 19 10:38:34.524770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 149/296] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:34.547498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.548103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.554056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.554535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.554969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.555655 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.556109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.556534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.571092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.571694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.577669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.578158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.578591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.579480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.579717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.580136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.599090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:34.694548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.698928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:34.703686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-805b6c24-90c0-489b-981b-4d5f08f5bf36 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1469 microversion: 2.1 time: 0.159890 Sep 19 10:38:34.708377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 148/297] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:34.709611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.710210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.716046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.716521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.716911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.717041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.717658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.718107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.718524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.725165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7e234011-ea66-4b46-8768-ddce9c587398 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.158353 Sep 19 10:38:34.725833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:34.757351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.758068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.764306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.764865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.765410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.766173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.766703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.767197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.779588 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.787122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-23227d64-1d29-40f1-a25c-38e330bdf44f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1294 microversion: 2.1 time: 0.081896 Sep 19 10:38:34.787696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:34.895652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:34.903698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-430927d7-24ad-4291-b32f-2993f63e0a19 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.150688 Sep 19 10:38:34.904257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 151/300] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:34.960247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:34.960853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:34.967111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.967590 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.968025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:34.968708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:34.969186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:34.969614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.093681 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.101919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7c4a768e-be7a-4eab-96fa-6d96116e923a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.145654 Sep 19 10:38:35.102487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 150/301] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:34 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:35.109496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:35.110135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:35.116548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.117030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.117490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.118174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.118630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.119049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.178495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.185996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-24bbcb9f-a52a-4fba-a580-aabba357a741 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1262 microversion: 2.1 time: 0.080296 Sep 19 10:38:35.186558 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 152/302] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:35 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1262 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:35.549342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:35.549954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:35.556050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.556535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.556979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.557699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.558164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.558593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.692228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.700881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.702402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.703584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2b5b96fa-dfb8-4f21-ac26-6cd5280b4cda tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1745 microversion: 2.20 time: 0.158258 Sep 19 10:38:35.704293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 151/303] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:35 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:35.729484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:35.730097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:35.739557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.739557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.739557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.739557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.739876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.739876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.748430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:35.749289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:35.757586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.758120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.758562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.761845 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.762544 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.763579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.920492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:35.929207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1b2d28c7-b7aa-4282-87bb-38c8232d9f06 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.185310 Sep 19 10:38:35.929785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 152/304] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:35 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:35.934373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:35.935110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:35.940745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.941199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.941702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.942395 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:35.942850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:35.943274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:35.999169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:36.009054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d385f56e-61ae-432a-9e97-128ca76323fb tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1469 microversion: 2.1 time: 0.283875 Sep 19 10:38:36.017220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:36.017742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 153/305] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:35 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1469 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:36.026701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e529075e-9a8f-4e99-a8ca-2f8a2c62c365 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1294 microversion: 2.1 time: 0.095931 Sep 19 10:38:36.027633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:36.028245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:36.041599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 153/306] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:35 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:36.047836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.048330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.048892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.049478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.052683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.053040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.125520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:36.127410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:36.131017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=4 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:36.135562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.136336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.137139 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.145598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.145598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.145598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.257930 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:36.266754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9f246855-9443-40b6-b147-99c086338cd2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.243050 Sep 19 10:38:36.267790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 154/307] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:36 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:36.272525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:36.273406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:36.279731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.280398 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.286128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.286128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.286456 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:36.288235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.292486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0419a5ae-d435-4a91-b41b-68c74156ef71 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.171057 Sep 19 10:38:36.293053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 154/308] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:36 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:36.293518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.355509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:36.363059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1766b1e-fb2b-47ca-bf86-96e5fa4368b6 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1254 microversion: 2.1 time: 0.094172 Sep 19 10:38:36.364146 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 155/309] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:36 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1254 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:36.492668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "355dbb41-49a2-4ef6-ac29-2545bf766759", "name": "network-vif-deleted", "tag": "1682b614-36cd-4110-b45d-b3d96f12d7b0"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:36.529697 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.530196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.530635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.542749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] Creating event network-vif-deleted:1682b614-36cd-4110-b45d-b3d96f12d7b0 for instance 355dbb41-49a2-4ef6-ac29-2545bf766759 on hv-cinder-85827 Sep 19 10:38:36.548308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-c264e0ab-cc5d-41d6-96d2-ac0aec56f8b6 req-c6450e6e-653c-4900-a689-af08eb560252 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071733 Sep 19 10:38:36.551414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 155/310] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:36.729795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:36.730404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:36.736335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.736831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.737301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.737996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.739028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.739459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.953709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:36.954418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:36.962935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.964333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.969637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.969637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:36.969637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:36.970188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:36.995596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.004310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.012710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.014244 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e201e787-c8e0-4354-b669-e4992790d4c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.288362 Sep 19 10:38:37.034700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 156/311] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:36 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:37.041977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:37.042848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:37.050260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.056681 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.064731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.066224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.069455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.070565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.135147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.135800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.136497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.137207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lazy-loading 'fault' on Instance uuid 355dbb41-49a2-4ef6-ac29-2545bf766759 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:37.151277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.162644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-967b9de0-0e5b-4592-b3a8-ddff69d3eae9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.212951 Sep 19 10:38:37.165179 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 156/312] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:36 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.170126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:37.170906 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:37.177596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.178391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.179180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.180104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.189209 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.190007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.307265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.323096 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4c6eaa2c-d691-4f38-97db-9e641d7bf356 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1312 microversion: 2.1 time: 0.156290 Sep 19 10:38:37.325150 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 157/313] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:37 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.342265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:37.342896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:37.352119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.354971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.354971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.354971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.354971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.355301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.366326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.376808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-024ceb27-4b14-4776-84dd-127af9d78070 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1304 microversion: 2.1 time: 0.339886 Sep 19 10:38:37.401095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 157/314] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:37 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1304 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.401095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:37.401095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:37.438689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.439383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.439833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.445865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.446351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.446795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.598221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.609570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c866cc7a-20cd-488b-b929-93b40ee1cf46 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.283428 Sep 19 10:38:37.610780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 158/315] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:37 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.617206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:37.622116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:37.625359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.626009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.626661 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.627724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.628360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.629521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.669667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.685804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-332c15be-6003-4714-97a9-50db95db7ee2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.294234 Sep 19 10:38:37.686624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 158/316] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:37 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.695438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cf75e-34c5-41a9-8c5f-39b4a844f223", "name": "network-vif-plugged", "status": "completed", "tag": "d6a0b5a8-2285-47d9-8f57-c4ec2f91335c"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:37.716281 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:37.720315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:37.720496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:37.720807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:37.726231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-432ef016-58f1-430a-9331-ba24eb02ce47 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1310 microversion: 2.1 time: 0.113317 Sep 19 10:38:37.743364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 159/317] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:37 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:37.752825 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] Creating event network-vif-plugged:d6a0b5a8-2285-47d9-8f57-c4ec2f91335c for instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 on hv-cinder-85827 Sep 19 10:38:37.766011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-3798aef6-3320-4ea1-9d50-02ca2aed879d req-245af40e-b5e8-4ef3-a0f2-dfac113d1975 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078341 Sep 19 10:38:37.769940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 159/318] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:38.042444 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.048368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.056344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.058411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.058411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.058636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.059068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.059523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.190126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.191841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.200926 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.201699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.203541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.203541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.205019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.205858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.357731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.385631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.394174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.401016 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ed6968ec-213f-45f8-bd42-503b528aa134 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.357753 Sep 19 10:38:38.418679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 160/319] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:38.426760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.429895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.453582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.456186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.459904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.459904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.460752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.461615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.683527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.692589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-30f75f66-00e4-4672-9e32-9632e5fb9938 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.283240 Sep 19 10:38:38.692987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.709577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:38.709876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-52dd4a09-eaae-4dfa-9b56-f048e8b11519 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.524232 Sep 19 10:38:38.710754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 160/321] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:38.720668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.721569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.726593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.727306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.735697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.736826 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.743314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.743314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.743314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.743626 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.743727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.743861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.743956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.744043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.745577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.746028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.800016 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.800612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.801577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.802029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lazy-loading 'fault' on Instance uuid 355dbb41-49a2-4ef6-ac29-2545bf766759 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:38.861938 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.873762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fe1870fc-eeed-4247-8004-01b4eaaddd6a tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1304 microversion: 2.1 time: 0.162968 Sep 19 10:38:38.885291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 162/322] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:38.893192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.893192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.902515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.903008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.904088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.904571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.905176 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.905874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.959933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:38.975816 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-299bcf03-1111-4545-8730-81052fe22fc3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.263433 Sep 19 10:38:38.976964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 161/323] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:38.982873 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:38.983598 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:38.993258 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.993896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.995332 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:38.996503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:38.997122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:38.998405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.106382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.114907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4cbba6b0-ced2-467f-9544-e94978a80cdf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.233075 Sep 19 10:38:39.122006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 163/324] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:39.216225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.234044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6a79284f-1fab-4d18-aa21-3daeadc90515 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1316 microversion: 2.1 time: 0.254812 Sep 19 10:38:39.235292 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 162/325] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:38 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:39.445305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:39.446606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:39.457616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.458446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.461863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.464797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.465539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.466216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.656203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.667551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.669509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.671314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-60b53d03-487c-4ea5-acd7-e8e81a2205c4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.238203 Sep 19 10:38:39.672286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 164/326] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:39 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:39.719122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:39.719928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:39.737397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.737896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.738977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.739696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.740157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.740588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.741375 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:39.742715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:39.749931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.751551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.752548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.753761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:39.755033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:39.755739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:39.990427 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:39.994325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:40.001959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ea06af3f-dd68-4173-a90b-c3d6053ce4cf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1314 microversion: 2.1 time: 0.268592 Sep 19 10:38:40.002699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 165/327] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:39 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:40.022550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:40.023261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:40.029453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.030299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.030849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.031285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.031737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.032400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.071910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.072448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.072889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.073398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lazy-loading 'fault' on Instance uuid 355dbb41-49a2-4ef6-ac29-2545bf766759 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:40.123764 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc8bbdc05484c239d0dc820b95ac664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993ad6a2ac01432a8d3b64fe272bd874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:40.128116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:40.138444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bc2db3df-1084-48d3-a487-8a7eb93feb21 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.422949 Sep 19 10:38:40.139350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-524859a7-f504-4445-ae11-76599093aa35 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 200 len: 1304 microversion: 2.1 time: 0.125092 Sep 19 10:38:40.153404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 166/328] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:40 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:40.153404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:40.153404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:40.153404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.153743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.159387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.159387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.159387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.159387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.168351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 163/329] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:39 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:40.174027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:40.174925 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:40.185756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.186378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.186896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.187672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.188685 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.189216 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.345675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:40.355818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a9511e16-b5bf-4241-ac1c-7f983af7156d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.213872 Sep 19 10:38:40.365781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 167/330] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:40 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:40.365781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:40.365781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:40.376512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.377109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.377607 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.378439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.379558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.380060 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.536984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:40.585100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:40.601228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5a9098c0-807e-4904-b0ce-b6609bd3003a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.237434 Sep 19 10:38:40.601228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 168/331] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:40 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:40.640954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:40.655433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e4ab87ff-b782-46be-b334-886de306d5e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.485628 Sep 19 10:38:40.656682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 164/332] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:40 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:40.700756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:40.701448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:40.709689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.710462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.710793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.711599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:40.712118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:40.713298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:40.803056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=20 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:41.032015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.032015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.032372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.032372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-71753133-ba52-42cc-8321-7ee9aad0ff16 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.327307 Sep 19 10:38:41.032372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 169/333] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:40 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:41.032634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.032634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.059167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.059666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.060106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.060837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.061411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.061753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.167645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.168665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] [instance: 355dbb41-49a2-4ef6-ac29-2545bf766759] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.176355 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.177207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.177875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.178886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.179674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.180492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.198923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] HTTP exception thrown: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Request method failure captured: Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 HTTP/1.1 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEaNn-n0zkvMdoPPShRIL2JzGYjyQBYL9PEmbPGJWi-NvlZsMnsEgcaq0ylJ5Iiib6tKV9bGMonAeqtGacrni_LOBkHUzC8cxuMXnBUp0wPdkiycZuMdR8m8ldDkUa8__LfvTs9_AIQKZcWk__KvXGW4O_5dvqyhHFwl7WSMjVKEkWw Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 993ad6a2ac01432a8d3b64fe272bd874 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesNegativeTest-457945420 Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:38:41.203162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/993ad6a2ac01432a8d3b64fe272bd874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/993ad6a2ac01432a8d3b64fe272bd874"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_993ad6a2ac01432a8d3b64fe272bd874", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/993ad6a2ac01432a8d3b64fe272bd874"}]}] Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesNegativeTest-457945420 Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 993ad6a2ac01432a8d3b64fe272bd874 Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesNegativeTest-457945420 Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesNegativeTest-457945420-project Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 0bc8bbdc05484c239d0dc820b95ac664 Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesNegativeTest-457945420-project Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. Sep 19 10:38:41.204701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '355dbb41-49a2-4ef6-ac29-2545bf766759'} Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:38:41.205511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. Sep 19 10:38:41.206804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:38:41.210406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] Returning 404 to user: Instance 355dbb41-49a2-4ef6-ac29-2545bf766759 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:38:41.210406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-419608da-e44a-413c-ad37-a267421ac854 tempest-VolumesNegativeTest-457945420 tempest-VolumesNegativeTest-457945420-project] 10.222.0.42 "GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759" status: 404 len: 111 microversion: 2.1 time: 0.042331 Sep 19 10:38:41.214038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 170/334] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/355dbb41-49a2-4ef6-ac29-2545bf766759 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:38:41.220050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.220771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.228811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.229446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.229973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.231496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.232652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.233131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.434957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.445706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-181ff6f5-e81d-40e7-82d6-c55d35140937 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.230431 Sep 19 10:38:41.447568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 171/335] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:41.454322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.455463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.464755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.465426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.466086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.467215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.467895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.468527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.511230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.556785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-253e968f-994c-4ec4-8032-a6231b75c66d tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1498 microversion: 2.1 time: 0.525459 Sep 19 10:38:41.562467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1498 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:41.623347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.623347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.638833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.641728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.645137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.646646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.647129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.647571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.735973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:41.748716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3bcf5e3c-340f-4520-abcf-f6d2965c75dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.299815 Sep 19 10:38:41.757885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 172/337] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:41.786040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2a322d-06ff-40fa-8360-2df1f450bccf", "tag": "e365e3c1-d43a-4f66-a27c-3c6f6a2511c1"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:41.814694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.817514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.823036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.847152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] Creating event network-changed:e365e3c1-d43a-4f66-a27c-3c6f6a2511c1 for instance ff2a322d-06ff-40fa-8360-2df1f450bccf on hv-cinder-85827 Sep 19 10:38:41.858702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-f028788a-71f2-4cd1-a727-de928c8aa3d0 req-34e9427d-6c74-4b1e-bbbd-cc23c04e3c55 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099020 Sep 19 10:38:41.864806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 173/338] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:41.873009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:41.873732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:41.885638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=14 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:41.895482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.896364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.897090 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:41.898089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:41.902463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:41.903231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.080943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.083221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-53951565-8cd7-41fb-923a-2b6e96b67203 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.216916 Sep 19 10:38:42.083797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 174/339] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:42.088236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:42.088834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:42.096304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.098587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.099045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.099747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.100259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.100693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.220123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.234791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3480aff3-e823-4846-bf5d-9d7224ab7165 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.618970 Sep 19 10:38:42.235582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 166/340] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:41 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:42.265366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.274236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.275673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.276835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0d8d96e5-841a-42f9-b091-9d10c63296f3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.192123 Sep 19 10:38:42.277428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 175/341] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:42 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:42.474882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:42.475754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:42.492462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.493010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.493477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.494483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.494941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.495503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.526051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:42.777505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:42.778188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:42.795596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.796759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.799942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.806892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:42.806892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:42.806892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:42.971019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:42.994841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-67f75503-9b38-463c-ab58-6d9c9c3a7e38 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.526628 Sep 19 10:38:42.997689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 167/342] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:42 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:43.093975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.105878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b22bbf8e-3c63-4313-9663-fb0f336a3bd8 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.333476 Sep 19 10:38:43.107041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 176/343] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:42 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:43.125639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:43.130610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:43.142360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.157527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.157527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.157527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.157527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.158490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.246175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:43.246898 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:43.261507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.262274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.263272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.265405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.266021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.267981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.316611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:38:43.465939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.494226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-398760dd-7ade-4d1a-9d2f-912efaa5cf65 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.390233 Sep 19 10:38:43.496604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 168/344] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:43 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:43.500644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:43.513272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:43.518960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.520027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.520594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.521283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.521812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.522259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.686172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-144d80b8-29df-4e87-8762-c63808117315 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "DELETE /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 204 len: 0 microversion: 2.1 time: 0.447559 Sep 19 10:38:43.686926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 177/345] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:38:43 2022] DELETE /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:38:43.694420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:43.698496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:43.703683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.705224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.705863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.707886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.708534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.708964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.756669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.771529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-feae7498-52e0-49ca-b574-abd1813be494 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.272181 Sep 19 10:38:43.772549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 169/346] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:43 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:43.797630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:43.798415 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:43.806707 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.807206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.807709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.808450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.817797 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.818360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.874918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.884234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.885828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:43.887108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8f8d7634-d6fc-4bcf-ac53-1a08455feaa3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.198715 Sep 19 10:38:43.889514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 178/347] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:43 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:43.894524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:43.907275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:43.908092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:43.908630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:43.923076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] Creating event network-changed:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:38:43.929146 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-da8f6801-e80f-4376-825e-f3b193156ac2 req-5c05c961-e4ff-4c16-a83c-b93d07dd5ee9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038266 Sep 19 10:38:43.930010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 179/348] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:44.006113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:44.019856 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0c607ec7-f38b-4f38-8ec6-c5f3709a51c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.244779 Sep 19 10:38:44.020445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 170/349] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:43 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:44.022412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:44.023341 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:44.029780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.030650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.031323 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.032232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.032890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.033557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.139219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:44.140370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:44.149430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.150219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.150864 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.152206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.152892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.154166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.192244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:44.202011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-091544e2-d48c-4dcb-8f16-c2049a786a4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.184486 Sep 19 10:38:44.223716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 180/350] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:44 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:44.387583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:44.397876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-52936562-e328-4492-96ca-4058bad6ee1d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.263752 Sep 19 10:38:44.413093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 171/351] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:44 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:44.523286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:44.523912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:44.543076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.543849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.544482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.545400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.545996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.546567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.798036 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:44.800200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:44.814448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.815289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.816744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.820488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.824227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.825002 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.924848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:44.941961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-638d9659-e86f-4022-ae5f-e1a89134915a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.422095 Sep 19 10:38:44.945788 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 181/352] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:44 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:44.959643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:44.960677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:44.973736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.974560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.975177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:44.976074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:44.978817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:44.979451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.020070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:45.155329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.163502 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0f5a145d-661b-4423-a1d6-b4c1e045362c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.370746 Sep 19 10:38:45.169410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 172/353] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:44 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:45.186490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:45.187369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:45.199589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.200375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.200960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.210001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.210722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.211315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.242883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.251457 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.254936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.256692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-658c02eb-7454-4029-af12-1d06696b1b9b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.309475 Sep 19 10:38:45.257641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 182/354] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:44 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:45.262535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:45.263691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:45.270415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:45.272125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.272857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.273542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.274484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.275161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.275801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.492595 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.502432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-624d2a21-5d85-4077-becf-a963b1496415 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.331671 Sep 19 10:38:45.503964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 173/355] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:45 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:45.511591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:45.512649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:45.520815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.524589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.524589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.524589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.524589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.525088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.583262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.592813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-71adf314-026e-4bbd-9205-788221de215f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.333892 Sep 19 10:38:45.614089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 183/356] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:45 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:45.738633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:45.752435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-13b3db57-5f0d-4107-845c-3712569c83c6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.246655 Sep 19 10:38:45.762685 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 174/357] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:45 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:45.969349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:45.971003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:45.977702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.978525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.979184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:45.980129 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:45.981015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:45.981761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.132454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.140890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-31f538a5-bc8a-4c09-b2d0-55c91585d687 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.175450 Sep 19 10:38:46.142078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 184/358] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:45 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:46.193537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:46.194136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:46.208645 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.226215 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.227972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.229468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.230429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.231368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.292666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:46.294274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:46.305219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.305970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.309405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.310368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.310993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.311586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.432253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.441510 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a4934a05-6e49-4d20-bbf8-1d4a4bbbae8e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.254199 Sep 19 10:38:46.462024 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 175/359] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:46 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:46.531946 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:46.532766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:46.533386 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.540946 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.541644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.541778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.542149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.542933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.543190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.543439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.543890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.544346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bca58971-32b5-4cec-9ffe-4e5a15ef5ddf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.256082 Sep 19 10:38:46.544909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 185/360] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:46 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:46.616188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:46.616800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:46.622714 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.623362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.623842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.624570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.625046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.625524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.702742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.702742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b8b68cd4-ae62-480d-ac05-cd14d9439dd2 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.173496 Sep 19 10:38:46.702742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:46 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:46.775710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:46.776319 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:46.780524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.782327 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.783001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.783450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.784152 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:46.784653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:46.785096 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:46.789641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-07370a6c-685d-4392-915a-322a2ed90b28 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.177455 Sep 19 10:38:46.790508 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 186/362] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:46 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:46.915929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:46.930642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7658cdec-3f34-434e-9268-f64d6aef081e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.158590 Sep 19 10:38:46.931451 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 177/363] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:46 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:47.178625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:47.179255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:47.194171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.199350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.199350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.199350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.199350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.200212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.401706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:47.412382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1ff96075-cf00-4b44-b1e9-9eedb2d0bf1a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.248294 Sep 19 10:38:47.414739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 187/364] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:47 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:47.467949 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:47.469312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:47.483976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.490278 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.490914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.491871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.492664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.494044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.575359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:47.575803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:47.584417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.584838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.594541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.595371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.595855 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.596290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.728883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:47.739084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-98dca99f-92e1-4d7d-9bd5-c093b4114e0d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.275115 Sep 19 10:38:47.757143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 178/365] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:47 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:47.764685 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:47.765643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:47.773440 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.774157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.774901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.775874 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.776670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.777360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.933584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:47.947487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:47.950570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:47.954883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-84b5bd5e-601b-421b-b031-5d0895fcdb85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.383409 Sep 19 10:38:47.954883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 188/366] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:47 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:47.959845 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:47.960850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:47.967317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.968388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.969031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:47.970043 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:47.970704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:47.971334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.009038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:48.017835 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-58aa4485-6546-4fee-ac7d-397e3fbef8bf tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.259291 Sep 19 10:38:48.018777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 179/367] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:47 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:48.023815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:48.024477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:48.043305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.043803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.044238 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.044946 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.046057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.046493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.204278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:48.221244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d7e24777-a969-4482-8704-732d6bf39fff tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.264944 Sep 19 10:38:48.224203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 189/368] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:47 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:48.321108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:48.329307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d4f70620-5835-444d-b2d0-a017571f0f75 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.308882 Sep 19 10:38:48.333274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 180/369] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:48 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:48.439554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:48.440284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:48.447488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.447976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.448408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.449127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.449746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.450383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.634473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:48.642909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0805f93f-dd19-4523-9720-bec3291b1075 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.208001 Sep 19 10:38:48.643570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 190/370] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:48 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:48.764202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:48.764821 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:48.772912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.773635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.774477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.775425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.776043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.776628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.937105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:48.960735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5d35ec41-27b2-4db0-ba43-89cc190c47dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.200756 Sep 19 10:38:48.977274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 181/371] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:48 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:48.987169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:48.987169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:48.993568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:48.993568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:48.993568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:48.993568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.086767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.086767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.086929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:49.086929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:49.086929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.086929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.087246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.087246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.087246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.087246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.215727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.226034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.227876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.229221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8e56b401-3140-42ed-b634-29a5d8cdb309 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.251827 Sep 19 10:38:49.230205 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 191/372] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:48 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:49.241993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.251932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:49.252156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-81857151-bfe9-44d0-893e-a37be06b9936 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.209636 Sep 19 10:38:49.252907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:49.259150 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.259636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.260068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.260752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.261250 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.261475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 182/373] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:49 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:49.261736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.355449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:49.356095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:49.372135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:49.374931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.375530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.376068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.376879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.377478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.378195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.432636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.444610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cbc47546-d72d-4cd1-a09d-41734f45ee30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.196254 Sep 19 10:38:49.447649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 192/374] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:49 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:49.578609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.596414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c62c35a8-3e7c-4d5a-a247-944391edbaab tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.242620 Sep 19 10:38:49.611802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 183/375] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:49 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:49.667980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:49.669157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:49.690234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.691291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.694390 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.695242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.697292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.700550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.724664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2a322d-06ff-40fa-8360-2df1f450bccf", "name": "network-vif-plugged", "status": "completed", "tag": "e365e3c1-d43a-4f66-a27c-3c6f6a2511c1"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:49.735468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:49.736236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:49.736826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:49.750351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:49.754426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] Creating event network-vif-plugged:e365e3c1-d43a-4f66-a27c-3c6f6a2511c1 for instance ff2a322d-06ff-40fa-8360-2df1f450bccf on hv-cinder-85827 Sep 19 10:38:49.793450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-2ae82f6e-aa6d-40ad-8fdb-374fb1805de9 req-d1caef54-47ec-40c2-afac-ee1580dc7f14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072526 Sep 19 10:38:49.797931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 184/376] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:49.937242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:49.955246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e2600c4d-5ba1-45cb-9238-c4a43a0a4f22 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.284071 Sep 19 10:38:49.955246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:49 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:50.011306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.012808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.030687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.038226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.038882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.039791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.040400 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.041608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.216669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.224791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4f3a21b7-9c2e-4fb1-b63b-e85259a727e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.220310 Sep 19 10:38:50.241800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 185/378] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:50.255716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.256329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.271079 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.271881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.272591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.273985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.276209 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.277910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.284615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.286394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.293984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.294798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.295463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.296510 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.297210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.298229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.497311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.509263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.511523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.513003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-734d37dc-2392-4b78-bebf-52e392c682ff tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.261659 Sep 19 10:38:50.513599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 194/379] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:50.519437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.520340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.527324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.528121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.528729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.529983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.530462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.530892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.531593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.541371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-96813bc7-f2df-47f3-ae14-4bbfb958ff2f tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.265937 Sep 19 10:38:50.578225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 186/380] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:50.625308 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.625920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.631982 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.632463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.632897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.633616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.634071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.634494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.672700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.680572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-193a5059-fd1c-4a51-b840-d173c6f0c400 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.165824 Sep 19 10:38:50.681168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 195/381] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:50.787643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:50.796406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-69f337fc-ac91-4282-8951-292e64de81cc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1724 microversion: 2.1 time: 0.175100 Sep 19 10:38:50.797029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 187/382] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:50.971625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:50.972424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:50.979170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.979657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.980094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:50.980780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:50.981273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:50.981700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.127545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.140227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-65606dbd-ab60-4153-b5ad-edcc58fb5546 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.172384 Sep 19 10:38:51.141134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 196/383] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:50 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:51.251998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:51.252788 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:51.269463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.270241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.271006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.272054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.272741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.273469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.486921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.495045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e2f66fcc-1788-4366-9885-f1a49b8542b1 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.248956 Sep 19 10:38:51.499019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 188/384] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:51 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:51.541552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:51.543029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:51.549703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.551181 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.551859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.552979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.553829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.554516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.605384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:51.606001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:51.619837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.620519 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.621198 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.622148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.622765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.623382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.817644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.836216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.838636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.842786 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-74d591cf-e97d-42cd-a4d7-797f06d444a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.306286 Sep 19 10:38:51.846358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 197/385] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:51 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:51.851866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:51.863645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:51.879328 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.880134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.880677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.881518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.882083 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.882614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.884775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:51.902102 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-939f4c00-dc25-4d58-ad0a-0206e2ce5a9b tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.301602 Sep 19 10:38:51.917088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 189/386] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:51 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:51.917088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:51.917088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:51.935200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.935691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.936122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:51.936810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:51.937288 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:51.937704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.095366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:52.105463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f9310a98-5bba-46a6-a490-4a04b43cfae5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.257048 Sep 19 10:38:52.106896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 198/387] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:51 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:52.165048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:52.165902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:52.173300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.173939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.174564 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.175603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.176162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.176701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.182429 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:52.289413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:52.298195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0159b31b-bb05-4b04-8cee-4eb71a773acf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1701 microversion: 2.1 time: 0.385511 Sep 19 10:38:52.298981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 190/388] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:51 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1701 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:52.322976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:52.323569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:52.329804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.330404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.330901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.333859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d29b35c5-cf18-4782-8635-2006c4ac2bed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.172999 Sep 19 10:38:52.334923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 199/389] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:52 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:52.357561 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Going to try to start instance {{(pid=127497) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 10:38:52.524547 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:52.525659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:52.538070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.540948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.541913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.543894 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.544542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.545230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.606757 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-94b780d9-85fb-441a-8b40-72e798564772 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.284292 Sep 19 10:38:52.615921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 191/390] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:38:52 2022] POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:38:52.626114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:52.627536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:52.640483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.646132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.647135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.648062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.648800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.649621 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.846367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:52.854412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ccf72213-aad5-4a0a-85fa-35b50d24c706 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.334400 Sep 19 10:38:52.854998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 200/391] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:52 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:52.874809 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:52.876878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:52.898969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.899739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.900341 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.902612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:52.903248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:52.905465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:52.978601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.012100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9a7e661e-b3a6-48eb-a4c6-bcd92c5ce6bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.388154 Sep 19 10:38:53.014766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 192/392] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:52 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:53.018035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:53.019423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:53.025655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.026275 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.026805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.027625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.028186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.028710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.188131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.194455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.205019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.209037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.211649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ae8cd5c4-2f7e-4b45-8cd9-362858c2ab0b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.340166 Sep 19 10:38:53.212918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-af6b05fd-b975-4e92-9822-e8fccb2336ce tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1504 microversion: 2.1 time: 0.196596 Sep 19 10:38:53.216328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 193/393] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:53 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:53.230391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 201/394] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:52 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:53.230568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:53.230568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:53.231590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.232242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.232843 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.233748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.234358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.234973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.358482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:53.359154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:53.374038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.374038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.374038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.374966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.374966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.375200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.584067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.595475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-be41ddaf-5b57-4016-858d-7b355e23ec86 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.377441 Sep 19 10:38:53.597327 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 194/395] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:53 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:53.604020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cf75e-34c5-41a9-8c5f-39b4a844f223", "name": "network-vif-deleted", "tag": "d6a0b5a8-2285-47d9-8f57-c4ec2f91335c"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:53.619718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.620491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.621212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.631316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:53.640859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3a7f33f9-90a0-4169-8464-5190a2e6467e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.285871 Sep 19 10:38:53.645338 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] Creating event network-vif-deleted:d6a0b5a8-2285-47d9-8f57-c4ec2f91335c for instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 on hv-cinder-85827 Sep 19 10:38:53.649817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 202/396] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:53 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:53.655553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-7dfd2ee1-5c7a-4798-a5f7-a4d41b934a47 req-556db3c7-5e1b-4d0e-b97d-9a5fe8456da9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055874 Sep 19 10:38:53.656808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 195/397] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:53.883500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:53.884715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:53.894557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.895426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.896044 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:53.896967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:53.897869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:53.899047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.038399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:54.039978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:54.047480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.048310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.049040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.050576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.051229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.051909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.064567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.075294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-59270b8e-2bb0-456c-bd71-2bf003e39924 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.196793 Sep 19 10:38:54.075896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 203/398] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:53 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:54.227482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.228358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4ea7ddd0-ebbc-41f7-947a-7aa9e47e5b18 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.196089 Sep 19 10:38:54.228934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 196/399] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:54 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:54.253237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:54.253920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:54.260532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.261018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.261547 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.262180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.262924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.263345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.271261 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:54.271945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:54.278702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.279186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.279734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.280434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.280892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.281344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.343301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.352233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f9f93dcc-de0a-4784-bd64-649730bd7806 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1462 microversion: 2.1 time: 0.103675 Sep 19 10:38:54.365528 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 204/400] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:54 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1462 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:54.620448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:54.625164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:54.630779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.631297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.641206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.642864 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.643553 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.644264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.767154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.776605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.778093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.779274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6e1c07cd-b656-49bb-9da5-979a87a290b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.513445 Sep 19 10:38:54.779836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 197/401] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:54 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:38:54.793996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:54.793996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:54.793996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.793996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.796584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.796584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:54.796584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:54.796584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:54.885556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.894108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-db914a74-2c59-4ac1-a9df-f3d57074eabe tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.278521 Sep 19 10:38:54.909892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 205/402] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:54 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:54.976051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:54.984581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c851f966-8917-459a-8bcc-08c25d954652 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.203637 Sep 19 10:38:54.997304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 198/403] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:54 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:55.099824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:55.100622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:55.107069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.107552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.107998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.108683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.109164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.109593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.240611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.250701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e9ee2eba-7d01-4929-96aa-95cc38633a53 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.155256 Sep 19 10:38:55.251275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 206/404] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:55 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:55.263897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:55.264518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:55.271816 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.272312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.272771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.273669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.274085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.274555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.375189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:55.375973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:55.382759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.383254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.383700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.384398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.384856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.385320 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.421651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.431225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d518000c-a63a-40ee-ad32-132c8b8bb45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.171422 Sep 19 10:38:55.432006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 199/405] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:55 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:55.448648 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.457227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9e3220e0-0ca5-4119-ad95-318d544cf965 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1299 microversion: 2.1 time: 0.085983 Sep 19 10:38:55.458767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 207/406] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:55 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:55.809480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:55.810139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:55.816758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.817288 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.817728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.818425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.818881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.819307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.923157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:55.923781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:55.930271 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.930754 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.931190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.931884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:55.932338 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:55.932761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:55.956784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.976677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.976677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:55.976677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bc5f2d9d-2638-45fc-b623-4e78a095c41f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1740 microversion: 2.20 time: 0.168322 Sep 19 10:38:55.976952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 200/407] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:55 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:56.011710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:56.012892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:56.035605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.039634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.039634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.039634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.039634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.039990 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.074053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:56.139094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:56.149087 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9eccb31d-cd5c-44e8-83f6-1dba0c25766d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1368 microversion: 2.1 time: 0.229637 Sep 19 10:38:56.150235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 208/408] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:55 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:56.274404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:56.275020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:56.278922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:56.281222 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.281710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.282152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.282853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.283312 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.283742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.286714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0e26ea9a-d2f7-44e7-a664-e93a74d63e60 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.280957 Sep 19 10:38:56.288968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 201/409] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:56 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:56.416502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:56.424765 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ce4157f0-cd36-4a70-9e51-4d7095f48d58 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.154107 Sep 19 10:38:56.425684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 209/410] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:56 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:56.455043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:56.455777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:56.463253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.464237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.464675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.465439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.465897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.466323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.479908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:56.484483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:56.486461 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.487493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.487931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.488627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.489098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.489526 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.523322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:56.523923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:56.524445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:56.524977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:56.601676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:56.607273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:56.610214 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e15d201e-1cc3-4dc0-afd3-d767c2b956aa tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.134088 Sep 19 10:38:56.611404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 210/411] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:56 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:56.629176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3f39ba75-4583-4178-9fdc-5ed70732b09d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.177839 Sep 19 10:38:56.629801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 202/412] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:56 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:56.999740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.000353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.007068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.007562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.007999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.008703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.009190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.009621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.140793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.150221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.151859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.153048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-33c029e3-42e3-4ef9-89a4-3e216bad1b55 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.157321 Sep 19 10:38:57.153641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 211/413] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:56 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:57.172209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.172938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.179778 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.180912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.181380 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.182164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.182623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.183052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.309933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.317037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.318448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.318711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.326090 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.328285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.328776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.329247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.402047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.412087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9006748f-ca31-4d41-9775-c154ef604d9c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1557 microversion: 2.1 time: 0.243452 Sep 19 10:38:57.428536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 203/414] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1557 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:57.436249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.437015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.444139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.444638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.445080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.445791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.446297 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.446722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.512826 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.521034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-885766d5-19a1-45ab-8f04-32bb76dec819 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.215013 Sep 19 10:38:57.521637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 212/415] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:57.526289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.526887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.533130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.533652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.534106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.535583 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.536242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.536834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.540353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d516c79f-388d-4967-97b1-ee73d419752c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107956 Sep 19 10:38:57.540972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 204/416] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:57.635989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.636834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.643771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.644735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.645710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.650067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.650067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.650467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.698545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.699484 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.700046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.700554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.701330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:57.708849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-221c0575-631d-47fb-8b19-20270ce79360 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.185317 Sep 19 10:38:57.709635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 213/417] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:57.717272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:57.717886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:57.728301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.728948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.729519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.730705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:57.732262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:57.732919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:57.767326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.778820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9895c4e2-84f4-41cb-96f2-07843cb987dc tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.147863 Sep 19 10:38:57.780334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 205/418] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:57.901382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:57.910025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fbbd4d5c-0909-4a86-954c-d73b77d08491 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.196594 Sep 19 10:38:57.910609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 214/419] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:57 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:58.178142 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:58.178975 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:58.186688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.187197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.187978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.188656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.189136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.192218 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.474245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.482943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.484438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.485721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5b392c92-3e9a-4112-9d2f-7e7635afc8a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.311483 Sep 19 10:38:58.486214 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 206/420] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:58 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:38:58.547690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:58.548289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:58.558904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.558904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.558904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.558904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.559286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.559286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.577902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:38:58.710419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.731260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f91d499f-23a5-417c-a4b7-a83ac25f25fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.187884 Sep 19 10:38:58.731857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 215/421] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:58 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:58.734597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:58.735599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:58.751432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.752167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.753282 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.754162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.754746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.755290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.803532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:58.804294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:58.810622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.811412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.812064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.813014 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.813720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.814362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.854667 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.855293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.855932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.856492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:38:58.900076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.907871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-08f81d50-c92a-4815-a701-1c4411aed2b8 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.108600 Sep 19 10:38:58.908441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 216/422] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:58 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:58.915891 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2a322d-06ff-40fa-8360-2df1f450bccf", "tag": "e365e3c1-d43a-4f66-a27c-3c6f6a2511c1"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:38:58.926783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.927515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.928260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.935887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:58.941422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] Creating event network-changed:e365e3c1-d43a-4f66-a27c-3c6f6a2511c1 for instance ff2a322d-06ff-40fa-8360-2df1f450bccf on hv-cinder-85827 Sep 19 10:38:58.944565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-45ec9f7e-9e96-4e82-88e4-9c536a154fe8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.215325 Sep 19 10:38:58.949101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 207/423] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:58 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:38:58.949237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-2492396d-af29-41a8-a911-f5a351eebae8 req-b9d57444-b9f3-4a29-820b-3921e78c4409 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037573 Sep 19 10:38:58.949237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 217/424] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:38:58.956519 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:58.957350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:58.964166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.964693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.965164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:58.965869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:58.966458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:58.966920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.109425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:59.117636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ff3f94d8-25f8-4165-afb3-03f50e11fea6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.171113 Sep 19 10:38:59.118208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 208/425] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:58 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:59.516011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:59.520489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:59.523393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:59.524010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:59.524645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.525361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:59.525817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:59.526343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.758122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:59.758831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:59.781341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:59.781927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:59.782438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.785404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:59.789518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:59.790433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.967266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:59.975530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1fa59088-6ca3-4a7b-ad5d-14bf75a3d570 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.222831 Sep 19 10:38:59.976111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 209/426] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:59 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:38:59.987784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:38:59.991389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:38:59.992009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:38:59.998104 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:38:59.998734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:38:59.999269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:38:59.999776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:00.000174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.000777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.001303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:00.001544 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.003308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-480eebbf-f44b-4591-93a8-a5ac8a44f55b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.492319 Sep 19 10:39:00.003869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 218/427] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:38:59 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:00.008997 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:00.009864 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:00.015976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.016632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.017337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.018760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.019419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.020022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.038515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.039257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.040993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.041639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:39:00.094234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:00.103440 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6aadf0b0-d454-4846-bfe8-4213ca8a8284 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.126130 Sep 19 10:39:00.104120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 210/428] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:38:59 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:00.143051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:00.143051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:00.149400 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.150157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.150602 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.151302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:00.151755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:00.152182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:00.196300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:00.204868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-138428fd-75c0-425b-9b7c-23776fe5af14 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.199800 Sep 19 10:39:00.211673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 219/429] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:00 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:00.393737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:00.399384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e9d535e1-12bc-4be2-bee7-708ebe4136fa tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1710 microversion: 2.1 time: 0.261284 Sep 19 10:39:00.399955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 211/430] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:00 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1710 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:00.998303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:00.998916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:01.006231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.006708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.007142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.007825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.008277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.008702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.038401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:01.039019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:01.045704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.046198 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.046636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.047333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.047794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.048228 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.166627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.174481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-24a52a33-dcf6-44a7-b366-232480cf7dee tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.180056 Sep 19 10:39:01.174987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 220/431] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:00 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:01.179470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:01.180104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:01.186049 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.186538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.186971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.187895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.188528 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.189776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.209228 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.209228 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.209524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.210956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6b45be87-7ec3-4c08-8440-3f464ffb7b9d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.176536 Sep 19 10:39:01.211529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 212/432] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:01 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:01.228383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.228928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.229417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.229891 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:39:01.238777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:01.239395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:01.245837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.246335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.246944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.247672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.248130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.248750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.285258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.294785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2986cbfa-9782-48d4-a529-d232478735c9 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.118662 Sep 19 10:39:01.295577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 221/433] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:01 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:01.400799 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.408907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-02e5a146-214f-48a0-be46-4bae85784159 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.184150 Sep 19 10:39:01.422066 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 213/434] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:01 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:01.422822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:01.423562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:01.431098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.431524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.431970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.432719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.433219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.433654 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.553695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "name": "network-vif-unplugged", "status": "completed", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:01.563555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:01.564045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:01.564516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:01.565475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:01.574322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d2c56fea-4001-4bc1-a391-b8292c2c02d1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1714 microversion: 2.1 time: 0.155636 Sep 19 10:39:01.575329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 222/435] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:01 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:01.576613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] Creating event network-vif-unplugged:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:39:01.583063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-7538b90f-676c-4ce8-8116-d673d6eb6060 req-ccc4b3b5-a42f-4742-9ef4-88211af0decb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033158 Sep 19 10:39:01.583688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 214/436] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:02.197874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:02.198618 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:02.204578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.205085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.205536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.206230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.206688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.207118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.240432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:02.241290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:02.247524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.248089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.248605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.249434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.249893 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.250356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.337476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.345210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-dc7b19f6-6668-40ef-b455-39607099e024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.151393 Sep 19 10:39:02.345786 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 223/437] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:02 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:02.350728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:02.351299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:02.356933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.357440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.358104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.358562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.359015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.359438 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.386489 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.390557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.391039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.391475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.391924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lazy-loading 'fault' on Instance uuid 635cf75e-34c5-41a9-8c5f-39b4a844f223 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:39:02.394954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.396377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.397622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c662e8d1-ce2c-4c66-b80b-4a0037bcd0be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.162817 Sep 19 10:39:02.398177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 215/438] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:02 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:02.431654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:02.432352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:02.432496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ae2fba5ddb4b30a7a8a3ecf10d28bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c8dde9309d4f128f53cd6ece43ea52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.438648 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.439143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.439746 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.439955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-860e73a1-03d7-4bf5-8984-f667a22f63b1 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 200 len: 1304 microversion: 2.1 time: 0.092729 Sep 19 10:39:02.440740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:02.440863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 224/439] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:02 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:02.440957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:02.441378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:02.567461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:02.575620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2ca8c11b-98d4-4e08-a689-fba6563b0921 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.147929 Sep 19 10:39:02.576189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 216/440] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:02 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:03.368403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:03.369096 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:03.378290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.378799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.380188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.380993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.381703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.382232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.424650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:03.425324 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:03.432421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.433180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.433552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.436219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.436219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.436219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.538222 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:03.546611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c86beabd-bc9f-4e8a-9cc9-6231277c015c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1520 microversion: 2.1 time: 0.182006 Sep 19 10:39:03.547190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 225/441] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:03 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:03.552760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:03.553760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] [instance: 635cf75e-34c5-41a9-8c5f-39b4a844f223] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:03.561411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.562182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.563396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.568513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.568513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.568513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.591840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] HTTP exception thrown: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Request method failure captured: Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 HTTP/1.1 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEZ8UIF-IZgZJcewXHQgcQ_SSU_Zm3Kp0CByO1m79ChMTsMm-MBpaHqjXpuNA4NQSHj1BBlylN9L8Dw0OPy5X-C3nE3yZGRmdpzOWsqrotVxxCKtwix3XShB_P9uVtDjisYcUXU927X1Wi0tJr1mYZooJprXMGMVMIPmaIfFfImo6AE Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 90c8dde9309d4f128f53cd6ece43ea52 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesActionsTest-1645666641 Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:39:03.603264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/90c8dde9309d4f128f53cd6ece43ea52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90c8dde9309d4f128f53cd6ece43ea52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_90c8dde9309d4f128f53cd6ece43ea52", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/90c8dde9309d4f128f53cd6ece43ea52"}]}] Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesActionsTest-1645666641 Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 90c8dde9309d4f128f53cd6ece43ea52 Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesActionsTest-1645666641 Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesActionsTest-1645666641-project Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 29ae2fba5ddb4b30a7a8a3ecf10d28bb Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesActionsTest-1645666641-project Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. Sep 19 10:39:03.605274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '635cf75e-34c5-41a9-8c5f-39b4a844f223'} Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:39:03.606008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. Sep 19 10:39:03.607314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:03.609025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] Returning 404 to user: Instance 635cf75e-34c5-41a9-8c5f-39b4a844f223 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:39:03.609025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ebc4c9cf-4aa2-4ef7-bc27-89458fe0b187 tempest-VolumesActionsTest-1645666641 tempest-VolumesActionsTest-1645666641-project] 10.222.0.42 "GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223" status: 404 len: 111 microversion: 2.1 time: 0.050770 Sep 19 10:39:03.609025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 226/442] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:03 2022] GET /compute/v2.1/servers/635cf75e-34c5-41a9-8c5f-39b4a844f223 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:39:03.609025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:03.609025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:03.619650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.620419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.620570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:03.621180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.622316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.623067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.623273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:03.624361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.625587 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-eb43053c-7dfa-403f-b603-71fab861fffa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1722 microversion: 2.20 time: 0.205591 Sep 19 10:39:03.626918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 217/443] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:03 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:03.670713 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "name": "network-vif-plugged", "status": "completed", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:03.681211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:03.686848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:03.686848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:03.686848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:03.695904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] Creating event network-vif-plugged:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:39:03.701050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-2e2bbd85-57ce-459b-a1d4-6543c2a6dd97 req-8bf1a7dd-bfdb-4cf4-ba18-ef860b2842c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034181 Sep 19 10:39:03.701669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 218/444] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:39:03.779151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:03.787579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-90abe1e3-4e7c-4645-9101-db0ff75de511 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.186256 Sep 19 10:39:03.788353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 227/445] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:03 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:04.571092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:04.571795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:04.578520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.579005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.579444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.580761 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.581263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.581691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.652456 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:04.653113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:04.659603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.660089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.660558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.661292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.661917 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.662354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.724044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:04.731867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-77730978-21a6-4e81-82b8-da6e6792d031 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1500 microversion: 2.1 time: 0.165290 Sep 19 10:39:04.732435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 219/446] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:04 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1500 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:04.757283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:04.757967 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:04.764173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.764755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.765287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.766043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.766565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.767055 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.804206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:04.813737 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:04.816048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:04.817298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2e9686c4-fca2-4ca5-8b89-453a92e7d96e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1725 microversion: 2.20 time: 0.169120 Sep 19 10:39:04.817843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 228/447] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:04 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:04.830776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:04.831582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:04.837570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:04.839071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.839563 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.840002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.840709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.841224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.841659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.917181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:04.928976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4b7a98a1-dd77-4865-a773-1c30a362d2f5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1516 microversion: 2.1 time: 0.175218 Sep 19 10:39:04.930462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 220/448] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:04 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:04.934770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67877a76-5654-4391-930d-9d8636217896"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:04.937206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:04.943657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.947790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.947790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.947790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:04.947790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:04.948218 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:04.992208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:05.017201 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f6719ee-187d-40c2-a211-a59c5fd0215b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.197563 Sep 19 10:39:05.021204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 229/449] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:04 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:06.025005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cdb84863-bbeb-4751-8e75-9f63197aecdf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.094233 Sep 19 10:39:06.029931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 221/450] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Sep 19 10:39:04 2022] POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments => generated 188 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:39:06.042317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:06.042932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:06.049465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.049955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.050389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.051094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.051607 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.052035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.154985 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:06.155710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:06.161752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.162235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.162672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.163361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.163814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.164237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.184237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:06.192484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4cb5bbd5-a6b9-49cb-bcc1-c5dbf3eb4c68 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.154023 Sep 19 10:39:06.193052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 230/451] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:06 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:06.207588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127497) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 10:39:06.439001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7e4c2960-1869-4698-b7b7-a79d91beefd1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/action" status: 202 len: 0 microversion: 2.20 time: 0.287985 Sep 19 10:39:06.440175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 222/452] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 19 10:39:06 2022] POST /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:39:06.448163 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:06.448777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:06.455027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.455675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.463856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.463856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:06.463856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:06.463856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:06.589160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:06.599739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:06.601200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:06.602366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c7fbbeaa-0bc1-4bc4-9ba9-7dd9194c7ca5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1751 microversion: 2.20 time: 0.158082 Sep 19 10:39:06.602923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 231/453] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:06 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:07.216192 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:07.216747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:07.223524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:07.224014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:07.224458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:07.225190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:07.225659 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:07.226065 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:07.396361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:07.404048 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6950dc80-7908-49a9-a555-d3afcea9e9dc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.192471 Sep 19 10:39:07.404693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 223/454] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:07 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:07.628768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:07.633015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:07.635788 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:07.636269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:07.636702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:07.637689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:07.638141 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:07.638563 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:07.656838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:07.776782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:07.785387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:07.786825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:07.791347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ec5904cf-34b8-4bee-b27f-557e047b6061 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1751 microversion: 2.20 time: 0.163610 Sep 19 10:39:07.791347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 232/455] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:07 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:08.427367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:08.428069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:08.434627 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.435113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.435548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.436243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.436696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.437189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.563699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:08.571366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9ab7b2cb-fe59-446f-88f7-5bfce36d3b6b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1358 microversion: 2.1 time: 0.148502 Sep 19 10:39:08.577872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 224/456] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:08 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:08.813842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:08.814961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:08.821339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.821826 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.822315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.823119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.823577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.824000 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.882805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:08.885290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:08.891630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.892121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.893150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.893847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:08.894312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:08.894736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:08.918249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'flavor' on Instance uuid 964df96c-580f-4da3-b3b4-fcc5b7c1079c {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:39:08.955695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:08.964168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:08.970385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:08.970385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-97bffe34-d984-4296-8913-4a3616ce977f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1753 microversion: 2.20 time: 0.157168 Sep 19 10:39:08.970385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 233/457] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:08 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:09.237081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8e1d1b49-2c02-45d9-96ff-bf47904f3e61 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/action" status: 200 len: 32 microversion: 2.1 time: 0.357823 Sep 19 10:39:09.237688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 225/458] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:39:08 2022] POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/action => generated 32 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 10:39:09.247395 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:09.248004 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:09.255082 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:09.255612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:09.256054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:09.257079 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:09.257560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:09.257972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:09.410314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:09.420839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a2db6ddd-81a6-4402-b360-7f82809bfb98 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.176964 Sep 19 10:39:09.421709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 234/459] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:09 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:09.599710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:09.600428 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:09.610280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:09.610914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:09.611458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:09.612331 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:09.612779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:09.613358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:09.992040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:09.993356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:10.000344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.001046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.002175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.002861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.003513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.004100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.026032 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.034734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9c750d32-7dba-47e9-ba6e-fa1847f9df5a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1548 microversion: 2.1 time: 0.443576 Sep 19 10:39:10.052002 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 226/460] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:09 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1548 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:10.060897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:10.062022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:10.069210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.070090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.070742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.071687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.072354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.072988 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.179591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.190210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.191794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.194307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9755468c-e001-4cc5-9486-f64789ff0c7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1753 microversion: 2.20 time: 0.205923 Sep 19 10:39:10.195980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 235/461] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:09 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:10.234492 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.242105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d1c6c43a-8506-443f-b4f6-e509fd7c1b77 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1548 microversion: 2.1 time: 0.186007 Sep 19 10:39:10.243225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 227/462] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:10 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:10.272702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:10.283734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.291363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Searching by: {'deleted': False, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32'} {{(pid=127496) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 10:39:10.298993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.299566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.300002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.300727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.301277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.301703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.400574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.multi_cell_list [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127496) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 10:39:10.444554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:10.445722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:10.453650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.454486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.455292 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.456365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.457019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.457687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.506598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-068afd68-3a5c-405b-95f5-deb8d90d45dd tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.237532 Sep 19 10:39:10.507182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 236/463] 10.222.0.42 () {58 vars in 1125 bytes} [Mon Sep 19 10:39:10 2022] GET /compute/v2.1/servers => generated 342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:10.522305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:10.523176 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:10.529946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.530445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.530915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.531695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:10.532041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:10.532468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:10.638019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.648923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6733fc66-3221-4eb6-ac59-cb2e78f51f88 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.207885 Sep 19 10:39:10.650385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 228/464] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:10 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:10.693577 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:10.701885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7a017695-305d-41ff-97d5-d02fbbdc44b9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1548 microversion: 2.1 time: 0.183521 Sep 19 10:39:10.712170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 237/465] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:10 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1548 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:11.223754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:11.224365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:11.226581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:11.231599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:11.232346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:11.232789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:11.233659 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:11.234117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:11.234546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:11.391219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:11.399005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:11.405768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:11.410613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:11.411130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ef21ba53-acfa-4428-8cd4-f3319fa14e7c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1753 microversion: 2.20 time: 0.191334 Sep 19 10:39:11.411692 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 229/466] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:11 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:11.680791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:11.681503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:11.688553 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:11.689307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:11.689752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:11.690450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:11.691065 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:11.691489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:11.889225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:11.902503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5292ecc1-de46-4649-9419-843c0aed2af3 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.222981 Sep 19 10:39:11.904210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 238/467] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:11 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:12.436562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:12.437195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:12.445735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:12.445970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:12.446401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:12.447306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:12.447801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:12.447959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:12.609950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:12.629426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:12.630969 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:12.632156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-018f83f4-2d71-4ffb-a170-fe008a114e4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.199936 Sep 19 10:39:12.632787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 230/468] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:12 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:12.939702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:12.942573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:12.950267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:12.950803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:12.951232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:12.952155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:12.952735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:12.953311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:13.260256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "265cc58b-b1e2-4e61-9b77-3f146290cc2d"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:13.260749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:13.263569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:13.270627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-20fdecc9-8045-43a4-a9a7-a7d0b39c123b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.338008 Sep 19 10:39:13.270812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:13.271435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:13.272018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 239/469] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:12 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:13.273477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:13.274224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:13.274698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:13.275129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:13.675732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:13.676492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:13.695628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:13.695628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:13.696005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:13.696850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:13.697474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:13.698032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:13.883689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:13.895197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:13.896847 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:13.898246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e66f102d-a04b-41b3-8880-847ab1b343ef tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.242455 Sep 19 10:39:13.898801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 240/470] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:13 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:14.296370 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:14.297806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:14.316598 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4370c760-7fa2-4956-a5dc-e282e150f85e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.060445 Sep 19 10:39:14.318697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 231/471] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:39:13 2022] POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 194 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:39:14.321635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:14.323154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:14.335432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:14.337881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:14.342116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:14.342860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:14.614235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:14.623766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e8a13738-d6b9-4f84-8786-3264ddbd5da1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.332070 Sep 19 10:39:14.642750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 241/472] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:14 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:14.928436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:14.929462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:14.937000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:14.945855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:14.946314 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:14.947068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:14.947524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:14.948142 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:15.152431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:15.176299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:15.188031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:15.202364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-142be3d4-9f59-4f73-82a2-b97fa52ee83c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.278655 Sep 19 10:39:15.210550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 232/473] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:14 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:15.652781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:15.653832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:15.674870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:15.675762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:15.676455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:15.677437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:15.678110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:15.678756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:15.953494 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:15.964966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1fb576d5-2d56-4892-af1c-b562ec720600 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.317671 Sep 19 10:39:15.965730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 242/474] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:15 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:16.252650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:16.302399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:16.302399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:16.302399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:16.302399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:16.302791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:16.302791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:16.302791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:16.463270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:16.472427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:16.480714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:16.480714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8fabd2f5-c205-452c-a742-cbad3373c357 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.228325 Sep 19 10:39:16.480714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 233/475] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:16 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:16.994019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:16.995309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:17.002608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:17.003369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:17.004018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:17.004887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:17.005520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:17.006113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:17.200337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:17.210109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8a8da75a-831a-449b-99f6-d873bf9238d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.219927 Sep 19 10:39:17.222094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 243/476] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:16 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:17.504018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:17.504683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:17.513396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:17.522566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:17.523374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:17.524382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:17.525004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:17.525604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:17.744059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:17.755562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:17.757311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:17.763728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cc98a882-8a14-45ff-89e9-648be995b69b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.263891 Sep 19 10:39:17.765349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 234/477] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:17 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:18.239797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:18.240565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:18.247817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:18.248422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:18.248945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:18.249869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:18.250546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:18.251403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:18.517670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:18.527889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-32d26e08-754c-4bd6-a773-f21ecc8d528f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.293137 Sep 19 10:39:18.529620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 244/478] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:18 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:18.816712 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:18.817356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:18.828884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:18.835398 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:18.835858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:18.836605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:18.837099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:18.837524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:19.025785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:19.035595 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:19.037050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:19.038284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-13b6adca-22b6-4192-9ae9-92a17667bd03 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.246361 Sep 19 10:39:19.039196 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 235/479] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:18 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:19.560499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:19.561806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:19.571491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:19.571980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:19.572413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:19.573155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:19.573613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:19.574038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:19.741927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:19.741927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-32f0e4e6-e592-4075-9016-ce808881c03e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.182579 Sep 19 10:39:19.741927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 245/480] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:19 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:20.065431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:20.066417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:20.073803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:20.074384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:20.074899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:20.075682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:20.076481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:20.077270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:20.253039 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:20.269158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:20.271098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:20.272581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0b420ef6-9f53-4060-a61a-5afe5fbcfef2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.212267 Sep 19 10:39:20.275808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 236/481] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:20 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:20.763632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:20.770735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:20.790117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:20.792579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:20.793318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:20.793984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:20.794992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:20.795650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:20.796296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:21.016063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:21.024718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-08659a04-2851-4fe2-be4a-31ec52bddf41 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.265122 Sep 19 10:39:21.025726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 246/482] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:20 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:21.303350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:21.304128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:21.310666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:21.311584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:21.312234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:21.313174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:21.314463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:21.315089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:21.477961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:21.491333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:21.492756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:21.494277 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-63961d05-2e02-40c0-baa9-9dff170adf8a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.194909 Sep 19 10:39:21.494867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 237/483] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:21 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:22.053341 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:22.054678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:22.072502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:22.073398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:22.075837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:22.077002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:22.078036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:22.078755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:22.470791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:22.479610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a3a7cca8-0599-47f1-9dc1-1e4445f80426 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.430807 Sep 19 10:39:22.480814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 247/484] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:22 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:22.533481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:22.534888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:22.542812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:22.543850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:22.544580 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:22.545779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:22.546535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:22.547316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:22.744293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:22.771403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:22.774179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:22.775341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-40a8e700-2fd6-47df-a8ca-ad5f955cfcf0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.245892 Sep 19 10:39:22.775909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 238/485] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:22 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:23.508658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:23.509467 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:23.516481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:23.516972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:23.517441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:23.518637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:23.519102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:23.519668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:23.697704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:23.701720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:23.710029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ca0c2fa1-4de9-4e1d-be1e-2aef573f974d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.207641 Sep 19 10:39:23.712877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 248/486] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:23 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:23.808832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:23.810364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:23.833823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:23.834588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:23.839122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:23.839122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:23.839122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:23.839122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:24.047425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:24.057434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:24.059536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:24.063817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e1033380-2192-42c4-87fb-3a46a4883aa8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.256825 Sep 19 10:39:24.065269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 239/487] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:23 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:24.734500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:24.736251 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:24.746628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:24.747119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:24.747561 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:24.748271 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:24.748730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:24.753286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:24.951637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:24.960238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-df16569f-a128-48ca-a741-336b4ebff084 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.230345 Sep 19 10:39:24.960848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 249/488] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:24 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:25.094541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:25.095353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:25.102479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:25.102970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:25.103434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:25.104116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:25.104631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:25.105030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:25.250143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:25.259635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:25.261219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:25.262654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a5ad4be2-a8de-4ab8-81d5-3a8ba0065e35 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.172080 Sep 19 10:39:25.271500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 240/489] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:25 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:25.983332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:25.984070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:25.991010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:25.991491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:25.991926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:25.992613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:25.993076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:25.993520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:26.140371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:26.150867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-70fdffc5-9119-4bc5-bd7e-51878979d889 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.171321 Sep 19 10:39:26.151446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 250/490] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:25 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:26.289166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:26.289849 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:26.297636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:26.301398 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:26.302227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:26.303200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:26.303988 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:26.304577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:26.470079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:26.479661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:26.481323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:26.482812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5b5d5964-39cd-4a37-89ee-aa2f3f609cca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.198096 Sep 19 10:39:26.483466 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 241/491] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:26 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:27.175973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:27.176651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:27.182783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:27.183268 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:27.183719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:27.184389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:27.184842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:27.185291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:27.317775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:27.325348 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-08270c2e-a405-46b9-88ae-a919a5dcf67e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.153906 Sep 19 10:39:27.325956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 251/492] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:27 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:27.509195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:27.509807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:27.516877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:27.517392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:27.517852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:27.518538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:27.518987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:27.519408 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:27.648899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:27.657978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:27.660496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:27.661525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e4b6c78f-4fa5-4f3e-bac7-2c2095528e96 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.156167 Sep 19 10:39:27.662118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 242/493] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:27 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:28.350077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:28.350077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:28.355560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:28.355560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:28.356012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:28.356722 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:28.357425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:28.357839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:28.571254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:28.577579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c420f459-f578-4e6c-b94d-e27fc2545f12 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.233821 Sep 19 10:39:28.578157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 252/494] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:28 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:28.687131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:28.688246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:28.694567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:28.695054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:28.695500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:28.696197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:28.696653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:28.697100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:28.835391 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:28.844076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:28.845540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:28.846717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-599a5c9f-aad6-4f93-ac98-186a37b6ce4b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.163606 Sep 19 10:39:28.847289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 243/495] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:28 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:29.605393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:29.606110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:29.612571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:29.613172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:29.613690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:29.614378 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:29.614834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:29.615253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:29.747440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:29.755448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-499fa665-346b-4fda-998c-42a4a946c95c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.153836 Sep 19 10:39:29.755920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 253/496] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:29 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:29.872017 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:29.872629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:29.879602 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:29.883356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:29.883356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:29.883356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:29.883356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:29.883716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:30.012114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:30.021593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:30.028855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:30.028855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-de64a6d0-8479-4a1c-a811-d29c2332a2e2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.156280 Sep 19 10:39:30.028855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 244/497] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:29 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:30.779188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:30.780028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:30.787374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:30.787860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:30.788487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:30.789384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:30.790007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:30.790442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:30.991094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:30.999056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1e2f587e-14b0-4559-8b61-8686671a44ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.223651 Sep 19 10:39:30.999822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 254/498] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:30 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:31.050307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:31.050923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:31.057596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:31.058184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:31.058844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:31.059613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:31.060374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:31.060989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:31.066490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:31.198701 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:31.207659 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:31.209131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:31.210291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-366e885c-9f42-4d77-9225-c5ce6652c0ca tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.164416 Sep 19 10:39:31.210853 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 245/499] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:31 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:32.022249 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:32.022852 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:32.029191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:32.029677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:32.030111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:32.030803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:32.031255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:32.032539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:32.175479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:32.184072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-dcb0ad60-ead5-44a1-afe0-fc92bb70430f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.165722 Sep 19 10:39:32.184849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 255/500] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:32 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:32.236855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:32.237590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:32.244424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:32.244987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:32.245525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:32.246227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:32.246682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:32.247111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:32.382301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:32.391754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:32.393227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:32.397101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ba7e3399-ea41-4aa9-b74a-f8388f85ac13 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.162419 Sep 19 10:39:32.397101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 246/501] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:32 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:33.207198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:33.207812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:33.214093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:33.214571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:33.215008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:33.215698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:33.216151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:33.216573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:33.345171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:33.352730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6bc4f98d-6f82-46c3-9f69-b4b1b4bb49e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.150378 Sep 19 10:39:33.353340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 256/502] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:33 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:33.419513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:33.420123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:33.427124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:33.427612 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:33.428055 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:33.428754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:33.429247 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:33.429683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:33.561763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:33.570830 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:33.579633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:33.579633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-05446215-0bb3-4c55-a468-878f9a32ce29 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.157974 Sep 19 10:39:33.579633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 247/503] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:33 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:34.376110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:34.376797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:34.383265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:34.390566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:34.390566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:34.390566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:34.390566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:34.392069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:34.518957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:34.527074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-66ae72f5-6900-4ed6-8bf4-397def8977e8 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.155335 Sep 19 10:39:34.527646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 257/504] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:34 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:34.599518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:34.600127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:34.607097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:34.607576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:34.608008 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:34.608700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:34.609174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:34.609641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:34.754819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:34.763955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:34.765418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:34.766695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-67b077a4-9d67-47ae-8bc7-fabf8402124e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.171224 Sep 19 10:39:34.767255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 248/505] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:34 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:35.550836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:35.551402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:35.553677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=57 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:35.558671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:35.559230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:35.559672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:35.560490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:35.560945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:35.561407 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:35.696072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:35.703804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1c4498ca-38a2-4391-9bbe-643a2f45a3e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.157528 Sep 19 10:39:35.704394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 258/506] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:35 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:35.795405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:35.796820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:35.803909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:35.804326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:35.804765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:35.805486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:35.805940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:35.806358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:35.941375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:35.951368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:35.952931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:35.954398 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f7f807db-18d9-4a48-88b7-a8858f14ba18 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.163841 Sep 19 10:39:35.955524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 249/507] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:35 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:36.125883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:36.126983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:36.132898 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.133416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.133854 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.134542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.134994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.135419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.516665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:36.532660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3caaef3b-ec4b-4ce1-a292-87e82f1f7fb0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1594 microversion: 2.1 time: 0.410444 Sep 19 10:39:36.537110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 259/508] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:36 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1594 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:36.727842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:36.728795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:36.735242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.736001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.736717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.737835 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.738342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.738771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.889600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:36.897803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-88dc0384-d799-4ee3-ba96-4e49845f0882 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1502 microversion: 2.1 time: 0.174157 Sep 19 10:39:36.901190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 250/509] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:36 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:36.921300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f613c391-fe2f-4181-b3b3-cb76fc175597"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:36.924052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:36.930907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.931396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.931835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.932531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.932983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.933477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.957706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] HTTP exception thrown: Cannot 'attach_volume' instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c while it is in vm_state rescued Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Request method failure captured: Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/os-volume_attachments HTTP/1.1 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 74 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEaAEpWevJa7FpLX7Feyysk1znYHiXN_UdOa63ocETlcpKwqN8cTVL0dgsXQO8sjKztfasagkAwf8Wf_696lM3XkDHU-IiVZ5yV4jovAb0ss4WnYBNDp8Vx53cnDNU6dEyLE8dRy__skRRa6____BiRE8m3UEqvs46_DSFt41SmIJWs Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:39:36.959299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af388d6e63d641528e8f00de41c59490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af388d6e63d641528e8f00de41c59490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}] Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: d3235496c38249a388e4afc263eadbc3 Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {"volumeAttachment": {"volumeId": "f613c391-fe2f-4181-b3b3-cb76fc175597"}} Sep 19 10:39:36.960831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Cannot 'attach_volume' instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c while it is in vm_state rescued Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'server_id': '964df96c-580f-4da3-b3b4-fcc5b7c1079c', 'body': {'volumeAttachment': {'volumeId': 'f613c391-fe2f-4181-b3b3-cb76fc175597'}}} Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:39:36.965718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c while it is in vm_state rescued Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:36.967241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c while it is in vm_state rescued Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Returning 409 to user: Cannot 'attach_volume' instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c while it is in vm_state rescued {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1ac72195-54ca-4969-b906-29fa0054f948 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043616 Sep 19 10:39:36.968631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 260/510] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:39:36 2022] POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 10:39:36.972845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:36.973325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:36.979401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.979900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.980343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.981048 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.981547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.981687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:36.981964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.982342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:36.988894 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.989428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.989905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:36.990611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:36.991065 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:36.991491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:37.142763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:37.154115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:37.156319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:37.157537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-04be5762-570c-4e2d-9b09-c52b910ed481 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.180253 Sep 19 10:39:37.158363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 261/511] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:36 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:37.212188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8faf282e-0bdd-4464-97b9-90501fc4d47a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/action" status: 202 len: 0 microversion: 2.1 time: 0.244245 Sep 19 10:39:37.215883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 251/512] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:39:36 2022] POST /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:39:37.221740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:37.222636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:37.228963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:37.229722 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:37.231111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:37.231896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:37.232528 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:37.233357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:37.370548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:37.378515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-44cd63c5-9125-4b71-b346-7e28284cb886 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1510 microversion: 2.1 time: 0.161247 Sep 19 10:39:37.379179 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 262/513] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:37 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:38.185561 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:38.186405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:38.193367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.193863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.194305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.195000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.195455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.195881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.408464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:38.408464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:38.411142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.411626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.412062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.412750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.413467 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.413914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.456179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:38.466958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:38.468615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:38.470039 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-32358bbe-1656-4d7e-98e7-9c06a0164136 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.289409 Sep 19 10:39:38.470925 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 252/514] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:38 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:38.530555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "name": "network-vif-plugged", "status": "completed", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:38.541775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.542518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.543099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.555813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] Creating event network-vif-plugged:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:39:38.561469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-03aa2a5d-e75d-45c1-8abb-686c94ad2426 req-eb267057-c5c9-4f83-90b2-3d6e17f777f6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Sep 19 10:39:38.562335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 253/515] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:39:38.581474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:38.589333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-43c677df-9ed8-41b8-9341-aaf43d541af0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1510 microversion: 2.1 time: 0.190781 Sep 19 10:39:38.589905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 263/516] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:38 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:38.871941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:38.884243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:38.884729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:38.888947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:38.902781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] Creating event network-changed:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:39:38.907941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-68a2a66b-5be2-423d-adc4-66e14b0fcc8a req-6d701bd8-c2d8-4af6-a825-57d2e15ee4dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040239 Sep 19 10:39:38.908541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 254/517] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:39.496964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:39.497672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:39.504891 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:39.505416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:39.505867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:39.506671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:39.507131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:39.507559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:39.614124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:39.618000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:39.624411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:39.624948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:39.625365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:39.626069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:39.626521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:39.626945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:39.703118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:39.714611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:39.716455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:39.717987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-80243578-a08e-4c6a-9d9f-e645756fec7d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.225167 Sep 19 10:39:39.729100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 264/518] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:39 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:39.785363 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:39.794154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6a597096-2d75-418f-868e-2e30e39e1736 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1510 microversion: 2.1 time: 0.185850 Sep 19 10:39:39.794662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 255/519] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:39 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:40.747922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:40.748530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:40.755738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:40.756311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:40.756756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:40.757513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:40.757964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:40.758573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:40.819782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:40.820425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:40.830590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:40.831136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:40.831575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:40.832283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:40.833457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:40.833838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:40.924725 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:40.929652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:40.937823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:40.939527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:40.942739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c5b615fa-20ef-4f03-a1fb-6833a707ee94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.197756 Sep 19 10:39:40.943937 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 265/520] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:40 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:41.014200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:41.029684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-caa15c67-61b9-48a1-8a2e-12eee69819ab tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1516 microversion: 2.1 time: 0.215276 Sep 19 10:39:41.030257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 256/521] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:40 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:41.636307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1426833707"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:41.639627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:41.650877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:41.651814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:41.655501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:41.655501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:41.655501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:41.655501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:41.884502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.network.security_group_api [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Adding security group 90e1f5cd-0727-4e95-9b17-12a01438d02c to port 679b3a2a-4d03-4c60-b1ac-06853d91645b Sep 19 10:39:41.967833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:41.968472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:41.974964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:41.975454 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:41.975900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:41.976707 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:41.977127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:41.977562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:42.113912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:42.123040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:42.124496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:42.125702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-af59f6ab-a915-42b3-a25a-f78054ff0f54 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.161833 Sep 19 10:39:42.126406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 257/522] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:41 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:42.377051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d3fe1f6f-1b36-44f8-946c-7f782a272bf7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action" status: 202 len: 0 microversion: 2.1 time: 0.745342 Sep 19 10:39:42.377051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 266/523] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:39:41 2022] POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:39:42.388174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:42.388390 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:42.389812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:42.396618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:42.397463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:42.398047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:42.398537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:42.398770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:42.398962 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:42.400071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:42.400634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:42.401367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:42.416582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] Creating event network-changed:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:39:42.426836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-cbd93b31-dd9d-4cb8-87d8-bc4f6d5cada7 req-7dbd05f7-a141-429d-abfb-05011d1e19c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042485 Sep 19 10:39:42.427744 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 267/524] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:42.566174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:42.574490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fd96adcc-cef4-49ed-94a5-3d2a193999a8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1641 microversion: 2.1 time: 0.193067 Sep 19 10:39:42.575057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 258/525] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:42 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1641 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:42.744608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-838b2f1b-6a5d-4111-bf05-3e3651c96185 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: .version_select at 0x7fb943693b80>, body: {"keypair": {"name": "tempest-keypair-1094615004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrvmmnumxGJYVCnJG+6QYlSD8JmnXNHDAfd0AFXXZq/bSiXcLrmkd7aZG0a0Q/qObQdoUTSfCudCRk4/Kb1wQwB+vIDziI/ZNjCrLmpfLy5FQvs8dcXDD37+3XrJFn16Q=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:42.761124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-838b2f1b-6a5d-4111-bf05-3e3651c96185 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for project af388d6e63d641528e8f00de41c59490. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:39:42.765671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-838b2f1b-6a5d-4111-bf05-3e3651c96185 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for user d3235496c38249a388e4afc263eadbc3 and project af388d6e63d641528e8f00de41c59490. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:39:42.867576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-838b2f1b-6a5d-4111-bf05-3e3651c96185 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128056 Sep 19 10:39:42.868337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 268/526] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:39:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:43.152190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:43.152798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:43.158764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=60 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:43.165571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:43.165571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:43.165571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:43.165571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:43.165991 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:43.165991 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:43.325486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:43.334149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:43.335801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:43.337126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4c5e0bcd-b86b-43f2-a204-2fe3cae64311 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.188838 Sep 19 10:39:43.337619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 259/527] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:43 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:44.364928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:44.366411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:44.377573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:44.378068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:44.378501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:44.379208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:44.379676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:44.380172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:44.648623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:44.662033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:44.663918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:44.665474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3e54903f-3ae3-4fe8-9862-fa7fa0755acf tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.305237 Sep 19 10:39:44.666414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 269/528] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:44 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:45.591488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1748219129", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6075686e-fc72-4e07-bc84-884b33c04b1a"}], "security_groups": [{"name": "tempest-securitygroup--128811513"}], "key_name": "tempest-keypair-1094615004", "user_data": "}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:45.692095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:45.692829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:45.699597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:45.700324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:45.700804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:45.703861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:45.703861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:45.703861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:45.844669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:45.854028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:45.855470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:45.856677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-080b79d8-c4ce-406d-abfd-2c9070324ea7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1809 microversion: 2.20 time: 0.168640 Sep 19 10:39:45.857275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 270/529] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:45 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:39:45.955706 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] validate_networks() for [('6075686e-fc72-4e07-bc84-884b33c04b1a', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:39:46.347604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:39:46.348165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:39:46.348652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:39:46.349195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:39:46.349622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:39:46.358774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:46.359261 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:46.359700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:46.360429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:46.360887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:46.361344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:46.377710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:39:46.382191 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Getting quotas for user d3235496c38249a388e4afc263eadbc3 and project af388d6e63d641528e8f00de41c59490. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:39:46.394243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:39:46.397265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:39:46.551128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-53decc31-ce4d-4753-9d6e-0185fccc5ce0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.964463 Sep 19 10:39:46.551983 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 260/530] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:39:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:39:46.563030 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-86c14587-e7a0-4564-a456-da8d41e0d3d4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:46.563641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-86c14587-e7a0-4564-a456-da8d41e0d3d4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:46.623620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-86c14587-e7a0-4564-a456-da8d41e0d3d4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:46.631766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-86c14587-e7a0-4564-a456-da8d41e0d3d4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1246 microversion: 2.1 time: 0.072530 Sep 19 10:39:46.632440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 271/531] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:46 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:46.883702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:46.884322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:46.892015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:46.892504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:46.892946 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:46.893675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:46.894132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:46.894556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:47.033113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:47.042061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:47.043506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:47.044674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fbb1167d-90b6-4001-bd0c-a1a631d81c50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1796 microversion: 2.20 time: 0.165559 Sep 19 10:39:47.045254 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 261/532] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:39:46 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1796 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:39:47.655421 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:47.656032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:47.665286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:47.665286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:47.665286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:47.665286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:47.665985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:47.665985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:47.728874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:47.736567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-33dd9cb9-0eaf-449b-84a8-f9724c08b1db tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1250 microversion: 2.1 time: 0.085311 Sep 19 10:39:47.737145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 272/533] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:47 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:48.765921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:48.766537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:48.773667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:48.774152 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:48.774589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:48.775275 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:48.775728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:48.776156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:48.843607 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:48.847154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:48.852490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e15fca3e-7a0b-4baf-8252-9b9e83e21181 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1298 microversion: 2.1 time: 0.090253 Sep 19 10:39:48.853530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 262/534] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:48 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:49.876709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:49.877392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:49.883862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:49.884348 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:49.884790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:49.885518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:49.885976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:49.886408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:49.975262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:49.982871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4ea96abc-2f0b-4be7-9ddb-6513f319d6e0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1304 microversion: 2.1 time: 0.109957 Sep 19 10:39:49.983381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 273/535] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:49 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:51.005515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:51.006183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:51.013298 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:51.013791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:51.014228 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:51.014916 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:51.015371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:51.015801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:51.058131 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:51.069211 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:51.069693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:51.070126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:51.082768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] Creating event network-changed:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:39:51.088534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-771585e1-040d-4782-8d8c-a2ffd8a0bb2d req-e6db3886-138d-4945-8a2b-0810590a3034 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034137 Sep 19 10:39:51.089169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 274/536] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:39:51.160445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:51.169320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0c6a43f8-0387-46f5-a3b9-26e91141a6ce tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.168389 Sep 19 10:39:51.169911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 263/537] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:50 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:52.192785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:52.197529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:52.199853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:52.200344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:52.200785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:52.201514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:52.201975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:52.202404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:52.330639 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:52.338865 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-849b495a-9aa7-48b8-81d5-964a1de1aec2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.150860 Sep 19 10:39:52.339437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 275/538] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:52 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:53.360999 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:53.366328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:53.368655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:53.369187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:53.369633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:53.370326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:53.370787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:53.371213 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:53.503246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:53.511545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a1de7cb0-16e2-498a-baf3-60f05314db59 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.154757 Sep 19 10:39:53.512103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 264/539] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:53 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:54.498869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:54.499953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:54.507699 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.511940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.511940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.511940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.511940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.512362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.538478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:54.538478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:54.543739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-03e72be6-01b0-4f2d-8916-f73ee3c49f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/ips" status: 200 len: 148 microversion: 2.1 time: 0.048630 Sep 19 10:39:54.544479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 276/540] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:39:54 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:39:54.544900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.545432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.545882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.546638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.547098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.547529 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.556074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "188c745e-4ac1-4619-aaf3-6bb63dc84f47"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:39:54.558637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:54.565983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.566464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.566896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.568121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.568572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.568998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.661886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: POST /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/os-volume_attachments HTTP/1.1 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 74 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:39:54.663893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {"volumeAttachment": {"volumeId": "188c745e-4ac1-4619-aaf3-6bb63dc84f47"}} Sep 19 10:39:54.665292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'server_id': 'ff2a322d-06ff-40fa-8360-2df1f450bccf', 'body': {'volumeAttachment': {'volumeId': '188c745e-4ac1-4619-aaf3-6bb63dc84f47'}}} Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:54.666086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:39:54.667970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 400 to user: Invalid volume: volume 188c745e-4ac1-4619-aaf3-6bb63dc84f47 is already attached to instances: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-039924c8-3f8e-41f4-9c8d-0352a21d013d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113479 Sep 19 10:39:54.669790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 277/541] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:39:54 2022] POST /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:39:54.675864 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:54.681756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:54.683237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.683732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.684173 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.685037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:54.685535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:54.685963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:54.698938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:54.706656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b4837e88-df34-4b36-b9e9-a8306cc7c908 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.176517 Sep 19 10:39:54.707222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 265/542] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:54 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:54.711717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:39:55.017642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f8873c88-da82-4c03-9b76-d4164eec2649 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 204 len: 0 microversion: 2.1 time: 0.345394 Sep 19 10:39:55.018491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 278/543] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:39:54 2022] DELETE /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:39:55.027059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:55.027715 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:55.034061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:55.034540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:55.034972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:55.035649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:55.036714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:55.037221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:55.171080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:55.178713 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1aadbc2-fc0e-4f13-98b6-d369410903c1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1681 microversion: 2.1 time: 0.155630 Sep 19 10:39:55.179273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 266/544] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:55 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:55.730885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:55.731622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:55.737988 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:55.738470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:55.738907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:55.739598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:55.740052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:55.740476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:55.877420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:55.885147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-11b6a5e8-1faf-4914-9daf-1177603c92c5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.158507 Sep 19 10:39:55.885771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 279/545] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:55 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:39:56.201900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:56.202507 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:56.209564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:56.210042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:56.210470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:56.211165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:56.211597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:56.212014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:56.339587 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:56.347236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a2eb1b31-6ea8-4f8d-a2e5-861795a22d16 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1681 microversion: 2.1 time: 0.149247 Sep 19 10:39:56.347796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 267/546] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:56 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:56.909144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:56.909697 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:56.911682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:56.917012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:56.917522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:56.917960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:56.918703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:56.919157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:56.919582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:57.050564 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:57.058165 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-370b3fcb-183a-4888-8391-8689677d013d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.152977 Sep 19 10:39:57.058723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 280/547] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:56 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:57.370564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:57.371179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:57.373046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:57.373720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:39:57.379007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:57.384025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:57.384025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:57.384025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:57.384025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:57.384436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:57.527226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:57.534869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1bc66fb6-ecf1-4825-9cfd-37a90e259624 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1681 microversion: 2.1 time: 0.168323 Sep 19 10:39:57.535439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 268/548] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:57 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:58.080844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:58.081501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:58.088384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:58.088882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:58.089352 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:58.090051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:58.090516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:58.090941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:58.221115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:58.229730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2fcd769f-addc-4bc4-b806-a66ad7493024 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.152755 Sep 19 10:39:58.230302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 281/549] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:58 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:58.565313 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:58.565899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:58.572780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:58.573296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:58.573735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:58.574455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:58.574910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:58.575335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:58.710498 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:58.718190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-434c4fca-d17d-4ed5-bc5e-853b409c6f64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1681 microversion: 2.1 time: 0.156952 Sep 19 10:39:58.718755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 269/550] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:58 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:59.252356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:59.252739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:59.259742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:59.260224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:59.260662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:59.261379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:59.261833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:59.262259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:59.520781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:59.529446 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9f905cc9-f4f4-4afb-91dc-1b0800bdb67c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.281453 Sep 19 10:39:59.532752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 282/551] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:59 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:39:59.742350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:39:59.742998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:39:59.749035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:59.749562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:59.750000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:59.750694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:39:59.751147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:39:59.751573 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:39:59.828202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:39:59.837294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6c82489d-b9d4-4c34-9bc9-2026856bd258 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1613 microversion: 2.1 time: 0.098752 Sep 19 10:39:59.837971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 270/552] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:39:59 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:00.059421 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2a322d-06ff-40fa-8360-2df1f450bccf", "name": "network-vif-deleted", "tag": "e365e3c1-d43a-4f66-a27c-3c6f6a2511c1"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:00.070870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.071465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.076158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.084563 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] Creating event network-vif-deleted:e365e3c1-d43a-4f66-a27c-3c6f6a2511c1 for instance ff2a322d-06ff-40fa-8360-2df1f450bccf on hv-cinder-85827 Sep 19 10:40:00.089991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-6e8e07e4-9793-4d0e-9c7c-f206cb4b3815 req-701a569a-0488-444b-8da8-1f044dc1cc04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034271 Sep 19 10:40:00.090661 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 283/553] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:00.554412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:00.555378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:00.562002 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.562695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.563412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.564836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.565547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.566300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.733043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:00.742436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5ad01bb6-83ef-4ee2-8d6b-dde863751bbd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.192626 Sep 19 10:40:00.743097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 271/554] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:00 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:00.866821 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:00.867592 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:00.874666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.875164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.875584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.876503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.877019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.877609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.916265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:00.916979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:00.917622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:00.918232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'fault' on Instance uuid ff2a322d-06ff-40fa-8360-2df1f450bccf {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:00.965657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:00.976004 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cc347199-e493-44fc-9424-474453385396 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 200 len: 1332 microversion: 2.1 time: 0.113801 Sep 19 10:40:00.990152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 284/555] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:00 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:01.013230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "name": "network-vif-plugged", "status": "completed", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:01.026533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:01.027349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:01.027796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:01.042416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] Creating event network-vif-plugged:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:40:01.047854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-3bfc8d37-d5af-4ced-913d-d4ec2da4631e req-2ce762cf-edef-4675-99cc-0caf48627128 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038900 Sep 19 10:40:01.048659 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 272/556] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:01.384802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:01.385423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:01.392140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:01.396829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:01.396829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:01.396829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:01.396829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:01.397665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:01.428756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:01.534354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'services' on Instance uuid fa2a3428-631d-490f-8f6b-23b4a1b0c30e {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:01.770889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:01.771593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:01.778080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:01.778561 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:01.779001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:01.779738 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:01.780194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:01.780664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:01.827114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9840e320-c9b0-4ddc-80b6-d6705bfaf0dc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments/c935841a-7932-4e7f-952e-5bea3a08f6c5" status: 202 len: 0 microversion: 2.1 time: 0.446107 Sep 19 10:40:01.828180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 285/557] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:40:01 2022] DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments/c935841a-7932-4e7f-952e-5bea3a08f6c5 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:01.936232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:01.945172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-93557ffb-6822-4766-9b9f-2a172fdea309 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.178420 Sep 19 10:40:01.945759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 273/558] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:01 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:02.002902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:02.003604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:02.010003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.010490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.010959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.011660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.012116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.012538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.027376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf HTTP/1.1 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:40:02.029053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:40:02.030614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'ff2a322d-06ff-40fa-8360-2df1f450bccf'} Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:40:02.031574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:40:02.033263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:02.034711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:40:02.034711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-59f0a87e-2271-40df-b34f-aab0dba6bfb5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 404 len: 111 microversion: 2.1 time: 0.032455 Sep 19 10:40:02.034711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 286/559] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:01 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:40:02.040892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ac088b72-2fd6-40a9-bec8-fc8057e7ee11 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '.version_select at 0x7fb9432184c0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:02.101532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ac088b72-2fd6-40a9-bec8-fc8057e7ee11 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208075752" status: 202 len: 0 microversion: 2.1 time: 0.064910 Sep 19 10:40:02.102145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 274/560] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 19 10:40:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208075752 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:02.891730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:02.892267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:02.899285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.899771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.900259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.901334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.905182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.905182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.967664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:02.968329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:02.975022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.975515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.975959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.976654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:02.977138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:02.977570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:02.996536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'services' on Instance uuid 2e7407bb-0aa4-4535-8b17-e90cd88cf96d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:03.116943 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:03.124670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-70c0aa9c-db55-4aa0-b8af-291b551e4060 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1371 microversion: 2.1 time: 0.160932 Sep 19 10:40:03.125269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 275/561] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:02 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:03.218005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cfa6928f-7d04-4aa4-a8a4-3037ae70fd98 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments/188c745e-4ac1-4619-aaf3-6bb63dc84f47" status: 202 len: 0 microversion: 2.1 time: 0.325887 Sep 19 10:40:03.218005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 287/562] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:40:02 2022] DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments/188c745e-4ac1-4619-aaf3-6bb63dc84f47 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:03.225577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:03.227826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:03.233945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:03.235592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:03.236095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:03.236897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:03.237436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:03.237860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:03.269459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cf16aff8-a961-4ef4-aa59-7f2fb1e02e64 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048402 Sep 19 10:40:03.270006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 276/563] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:03 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:04.149653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:04.150240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:04.156216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.156690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.157146 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.157825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.158273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.158693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.282583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:04.284688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:04.289278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:04.291311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.291806 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.292240 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.292940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.293467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.293891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.298711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ce06f529-c6a9-47aa-bc13-4181fe7cf421 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1564 microversion: 2.1 time: 0.154352 Sep 19 10:40:04.299291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 288/564] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:04 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:04.321411 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:04.321900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:04.324915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9f072620-c55a-4943-99f6-fea415b78c61 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Sep 19 10:40:04.325522 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 277/565] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:04 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:04.327907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.328388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.328816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.329533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:04.330046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:04.330529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:04.406561 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c5add313-cd21-4e9e-b938-bfc9db49b88a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089404 Sep 19 10:40:04.407157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 289/566] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:40:04 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:05.338114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:05.343335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:05.350530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:05.351219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:05.351649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:05.352697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:05.353383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:05.353960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:05.367452 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:05.379672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:05.380719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:05.381183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:05.398489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] Creating event network-changed:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:40:05.403506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-4d1e907e-6c7a-4646-b53a-36c4b94474c1 req-90bea2b2-9c58-4f64-af79-fdd23b8ebe29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041233 Sep 19 10:40:05.404104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 290/567] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:05.407354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2f20bdc0-7fd7-498b-ba9d-d225d8374178 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073799 Sep 19 10:40:05.407945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 278/568] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:05 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:06.420597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:06.422875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:06.425449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:06.430833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:06.431319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:06.431759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:06.432453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:06.432907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:06.433356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:06.463115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5b3adb71-68f4-43b3-9a2a-65392069cb5d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046804 Sep 19 10:40:06.463676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 291/569] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:06 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:07.477031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:07.479475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:07.486379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:07.487012 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:07.487554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:07.488389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:07.488998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:07.489672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:07.520253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-49b02fc4-bf89-498f-952a-ead9f6047039 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047197 Sep 19 10:40:07.521543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 279/570] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:07 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:08.260936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:08.267546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:08.268063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:08.268523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:08.329050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Going to try to stop instance {{(pid=127496) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 10:40:08.485560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-baf6f390-3895-4e4d-8433-a18586e80a00 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.228729 Sep 19 10:40:08.486172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 292/571] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:40:08 2022] POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:08.495037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:08.495645 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:08.502424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:08.502917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:08.503341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:08.504033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:08.504479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:08.504902 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:08.537499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:08.544453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:08.558913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:08.559880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:08.560497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:08.561605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:08.562245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:08.562875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:08.599591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3cb7d008-92cf-4274-bfbd-958f345604f0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066481 Sep 19 10:40:08.600242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 293/572] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:08 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:08.653013 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:08.660917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-eea95dca-31bd-40e5-a496-6ab40004e628 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.169931 Sep 19 10:40:08.662078 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 280/573] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:08 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:09.612135 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:09.614312 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:09.620807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.621332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.621774 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.622462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.622918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.623346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.653612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9b605563-45a1-4b87-83c9-20b8fb44d0a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045428 Sep 19 10:40:09.654345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 294/574] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:40:09 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:40:09.685455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:09.686113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:09.692346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.693360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.693800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.694499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.694955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.695382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.699678 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:09.718802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:09.719302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:09.725409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.725919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.726440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.727164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:09.727622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:09.728055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:09.755871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:40:09.828343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:09.836773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-09f243e7-87c8-4066-897e-66b1af97b326 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.154884 Sep 19 10:40:09.837367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 281/575] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:09 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:10.031259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fd0b978e-8ba8-4746-9a2d-74598b56d56d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 204 len: 0 microversion: 2.1 time: 0.316142 Sep 19 10:40:10.031874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 295/576] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:40:09 2022] DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:40:10.040613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:10.041271 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:10.047208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:10.047680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:10.048111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:10.048786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:10.049274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:10.049695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:10.178110 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:10.185971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bd2894c7-19a6-482a-adf4-62279c37a2b1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1680 microversion: 2.1 time: 0.149745 Sep 19 10:40:10.186536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 282/577] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:10 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:10.860402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:10.861227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:10.867589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:10.868106 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:10.868520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:10.869269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:10.869717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:10.870145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:11.000738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:11.008973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f68d9e97-9012-42b9-830a-87a79d73d3b4 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.152792 Sep 19 10:40:11.009596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 296/578] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:10 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:11.209997 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:11.210831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:11.218786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:11.224376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:11.224376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:11.224376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:11.224376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:11.224749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:11.353869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:11.362044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-83f1a05e-34ad-4309-a4a2-8d4ec74fe868 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1680 microversion: 2.1 time: 0.156559 Sep 19 10:40:11.362634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 283/579] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:11 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:12.032871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:12.033502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:12.040184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:12.040715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:12.043306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:12.043306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:12.043306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:12.043306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:12.172562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:12.180228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-56a2a3af-f42c-41b0-acd6-380c3b1fc50c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.151291 Sep 19 10:40:12.180789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 297/580] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:12 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:12.400467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:12.401040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:12.407612 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:12.408094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:12.408521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:12.409237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:12.409682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:12.410190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:12.540850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:12.548833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2b508e1e-59fb-4c49-ac01-4b6ba9c31a05 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1680 microversion: 2.1 time: 0.152999 Sep 19 10:40:12.549424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 284/581] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:12 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:13.203288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:13.203832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:13.210486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:13.210960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:13.211389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:13.212077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:13.212677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:13.213151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:13.426068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:13.434916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9eede736-cb33-4ccd-94ce-f0d875bbc45f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.236176 Sep 19 10:40:13.435663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 298/582] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:13 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:13.473205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e7407bb-0aa4-4535-8b17-e90cd88cf96d", "name": "network-vif-deleted", "tag": "46456a98-39a8-4dce-9255-b1a67d65e7e9"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:13.482722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:13.484585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:13.485092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:13.485617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:13.500483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] Creating event network-vif-deleted:46456a98-39a8-4dce-9255-b1a67d65e7e9 for instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d on hv-cinder-85827 Sep 19 10:40:13.505766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-9e35562b-1096-4eae-828a-ac0cf5c66e7b req-c3d4ac4d-8113-4da1-9428-cfd66eae412e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036176 Sep 19 10:40:13.509369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 285/583] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:13.579556 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:13.580339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:13.590048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:13.593640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:13.594479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:13.595346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:13.595920 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:13.596582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:13.626825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:13.675679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:13.688935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5024fb53-8218-40ad-a04a-a2e200b57e4f tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1326 microversion: 2.1 time: 0.120140 Sep 19 10:40:13.690981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 299/584] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:13 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:14.460445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:14.461955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:14.490636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:14.491309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:14.491757 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:14.492528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:14.494362 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:14.494806 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:14.691931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:14.702345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f84ed40c-e6c6-48d2-afcf-869ccab383fe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.247109 Sep 19 10:40:14.715783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:14.716404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:14.717368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 286/585] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:14 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:14.723808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:14.724967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:14.727463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:14.727463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:14.727463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:14.727463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:14.760451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:14.761375 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:14.762009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:14.762890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'fault' on Instance uuid 2e7407bb-0aa4-4535-8b17-e90cd88cf96d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:14.812569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:14.825294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-16a19fc0-f3f2-4709-8a9f-24d03dbcb7b5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 200 len: 1331 microversion: 2.1 time: 0.113936 Sep 19 10:40:14.826486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 300/586] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:14 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:15.726633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:15.727331 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:15.733623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:15.734105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:15.734634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:15.735353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:15.735801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:15.736220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:15.852858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:15.853530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:15.860128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:15.860620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:15.861068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:15.861782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:15.862334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:15.862761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:15.877535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:15.879347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d HTTP/1.1 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:40:15.881623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:40:15.883192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '2e7407bb-0aa4-4535-8b17-e90cd88cf96d'} Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:40:15.884199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:40:15.886360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:40:15.888979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:40:15.888979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-578ca5ca-6e56-4f07-8f97-99d89858d28e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 404 len: 111 microversion: 2.1 time: 0.034347 Sep 19 10:40:15.888979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 301/587] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:15 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:40:15.891903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5f530d97-ee6b-4666-8579-6882603e0814 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '.version_select at 0x7fb9430b14c0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:15.893200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-02db04e5-307c-496d-87cd-a29c47e4c4b2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.170623 Sep 19 10:40:15.893880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 287/588] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:15 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:15.979545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5f530d97-ee6b-4666-8579-6882603e0814 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102349038" status: 202 len: 0 microversion: 2.1 time: 0.091384 Sep 19 10:40:15.980118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 302/589] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 19 10:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102349038 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:16.771734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-74647052-bf9f-4cd5-94d1-ae77ad2ed4b3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: .version_select at 0x7fb943218670>, body: {"keypair": {"name": "tempest-keypair-143317783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY/SVaJjiYAwxFvFIGFnJaI/P8+S0Um/HrQKQci2arZXX+oUK6L2xj9O3tAjUQJPJv2/392D+UJ0W9bG/ehhwzzHRvGSTprieY4IvsJkD6N3X/AZW0Wot4lI0nAuuGLaw=="}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:16.788231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-74647052-bf9f-4cd5-94d1-ae77ad2ed4b3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:40:16.792101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-74647052-bf9f-4cd5-94d1-ae77ad2ed4b3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:40:16.901435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-74647052-bf9f-4cd5-94d1-ae77ad2ed4b3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133976 Sep 19 10:40:16.902037 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 288/590] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:40:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:16.916208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:16.919704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:16.924373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:16.924866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:16.925353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:16.926133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:16.926595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:16.927027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:17.096499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:17.104288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9704e76b-0d50-4c68-aabb-78199c428d66 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.192611 Sep 19 10:40:17.104895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 303/591] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:16 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:18.129268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:18.129887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:18.137574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:18.139665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:18.139665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:18.139665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:18.140000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:18.140429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:18.360785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:18.369481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5d60b832-6fdd-4a72-8e5e-909ffefb2f23 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1678 microversion: 2.1 time: 0.245522 Sep 19 10:40:18.370105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 289/592] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:18 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:19.343229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-943858016", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c"}], "security_groups": [{"name": "tempest-securitygroup--1428567450"}], "key_name": "tempest-keypair-143317783", "user_data": "}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:19.396389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:19.398276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:19.405848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.406429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.406935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.407733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.408263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.408781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.451651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] validate_networks() for [('9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:40:19.562359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:19.572658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b94678bc-3602-41c0-b9ab-57b2db13af0b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1655 microversion: 2.1 time: 0.181518 Sep 19 10:40:19.573637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 290/593] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:19 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:19.601865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:19.613788 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.615024 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.615653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.640068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Going to try to start instance {{(pid=127497) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 10:40:19.851653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3b1d30b7-74a5-4b12-8afb-7ed200608788 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action" status: 202 len: 0 microversion: 2.1 time: 0.259310 Sep 19 10:40:19.852272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 291/594] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:40:19 2022] POST /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:40:19.871980 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:19.872836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:19.874285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:40:19.874784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:40:19.875333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:40:19.875775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:40:19.876188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:40:19.879439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.880009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.881115 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.881907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.882486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.882987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.885752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.886231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.886666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.887393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:19.888481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:19.889202 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:19.905637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:40:19.909630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:40:19.921381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:40:19.925093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:40:20.057561 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cc4f98eb-5b8d-41ee-b58c-b39da625948c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718650 Sep 19 10:40:20.058636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 304/595] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:40:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:40:20.071767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d749a5cc-5c6a-49cf-a911-3554e97a1343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:20.072163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:20.072589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d749a5cc-5c6a-49cf-a911-3554e97a1343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:20.079984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ef5f1640-d03a-46ad-84db-7cd634270abc tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1664 microversion: 2.1 time: 0.212143 Sep 19 10:40:20.080571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 292/596] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:19 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:20.170368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d749a5cc-5c6a-49cf-a911-3554e97a1343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:20.179193 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d749a5cc-5c6a-49cf-a911-3554e97a1343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1240 microversion: 2.1 time: 0.112614 Sep 19 10:40:20.179902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 305/597] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:20 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:21.103160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:21.103976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:21.119576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:21.119576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:21.119576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:21.119576 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:21.119911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:21.119911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:21.202335 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:21.202946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:21.209804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:21.210337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:21.210858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:21.211824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:21.212473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:21.212904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:21.250839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:21.259230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-92081a05-e662-4fa7-87b4-922e97c95c8a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1664 microversion: 2.1 time: 0.159857 Sep 19 10:40:21.259818 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 293/598] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:21 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:21.277606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:21.285516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f96916ae-9298-4b63-b533-9e52ddba3e99 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1244 microversion: 2.1 time: 0.086973 Sep 19 10:40:21.286089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 306/599] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:21 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:22.100737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:22.103119 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:22.109617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.110211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.110504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.111196 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.111649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.112072 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.282560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:22.283099 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:22.289353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.289928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.290372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.291286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.291813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.292248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.343894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-513a0f5d-6a79-4d5a-bf20-25fda0df6ee0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action" status: 202 len: 0 microversion: 2.1 time: 0.246916 Sep 19 10:40:22.347509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 294/600] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:40:22 2022] POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:40:22.350059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:22.351003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:22.359220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.359716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.360163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.360867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.361366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.361786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.426773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:22.438099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c558194c-3e39-4989-abf3-ad0216382264 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1292 microversion: 2.1 time: 0.092042 Sep 19 10:40:22.438689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 295/601] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:22 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:22.444016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:22.444850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:22.450931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.451651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.452258 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.453430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:22.454051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:22.454638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:22.487143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:22.497008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-025588d6-fb9e-484c-855c-24ecbe656e9e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1668 microversion: 2.1 time: 0.218280 Sep 19 10:40:22.510490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 307/602] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:22 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1668 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:22.610971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:22.620478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9f9f78a9-4ab4-448a-9909-458ce4cf2392 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1751 microversion: 2.1 time: 0.180779 Sep 19 10:40:22.621050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 296/603] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:22 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:23.463675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:23.464867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:23.471323 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:23.471817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:23.472259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:23.472987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:23.473500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:23.474674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:23.537633 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:23.545272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cf4a0939-9706-4a2a-a6f2-f0d91bb1b70e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1300 microversion: 2.1 time: 0.085362 Sep 19 10:40:23.550183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 308/604] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:23 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:23.647176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:23.648483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:23.656080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:23.656772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:23.657526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:23.658393 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:23.659022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:23.659579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:23.719436 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:23.855842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:23.864479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e7d9c345-057e-4544-952a-a352d8232fa9 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1751 microversion: 2.1 time: 0.222467 Sep 19 10:40:23.865152 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 297/605] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:23 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:24.568668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:24.569415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:24.576192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:24.576676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:24.577124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:24.578112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:24.578567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:24.579074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:24.720583 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:24.728447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-70b6daca-117c-4737-b205-422339f36209 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.164320 Sep 19 10:40:24.729051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 309/606] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:24 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:24.890009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1406098958", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "networks": [{"uuid": "baccb219-7bb1-470f-8538-2b1936275ec5"}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:24.890542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:24.891166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:24.898981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:24.899666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:24.900311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:24.901202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:24.901828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:24.902255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:24.946264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] validate_networks() for [('baccb219-7bb1-470f-8538-2b1936275ec5', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:40:25.113966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:25.122559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-508fae4e-5afc-4c79-89f0-e389d148d883 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.238784 Sep 19 10:40:25.123227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 298/607] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:24 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:25.294092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:40:25.296985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:40:25.296985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:40:25.296985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:40:25.296985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:40:25.304848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:25.305380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:25.305816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:25.306548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:25.307007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:25.307431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:25.328145 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Getting quotas for project b082859e089143dda3eefee066e4916d. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:40:25.332353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Getting quotas for user 884620036bb44462964db97238091c19 and project b082859e089143dda3eefee066e4916d. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:40:25.345319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:40:25.347495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:40:25.468499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-869a631a-6087-433b-85c5-d83008a6c492 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582407 Sep 19 10:40:25.469165 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 310/608] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:40:25.480074 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-73ec0904-3070-4358-bc7b-03e37a67550a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:25.480687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-73ec0904-3070-4358-bc7b-03e37a67550a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:25.548527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63471bae-c8d3-4b0d-a78a-662fece52413", "tag": "c7008b17-5a50-4d85-96c4-a43efa4cf1f5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:25.549823 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-73ec0904-3070-4358-bc7b-03e37a67550a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:25.560843 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-73ec0904-3070-4358-bc7b-03e37a67550a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1219 microversion: 2.1 time: 0.080543 Sep 19 10:40:25.560973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:25.560973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:25.560973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:25.561497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 299/609] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:25 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:25.571342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] Creating event network-changed:c7008b17-5a50-4d85-96c4-a43efa4cf1f5 for instance 63471bae-c8d3-4b0d-a78a-662fece52413 on hv-cinder-85827 Sep 19 10:40:25.576936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-d6110c86-80d2-4d7e-a690-fdd877e7aa58 req-815e055c-f2fc-42f9-b833-b5ef1485f84d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Sep 19 10:40:25.577978 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 311/610] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:25.750673 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:25.751570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:25.757868 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:25.758359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:25.758801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:25.759559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:25.760016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:25.760446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:25.974918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:25.984099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0039912c-887c-420f-9416-36740a61c34d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.237387 Sep 19 10:40:25.984910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 300/611] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:25 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:26.146901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:26.147601 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:26.154595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:26.155151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:26.155592 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:26.156299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:26.156756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:26.158804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:26.312930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:26.323077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-177bc322-cc77-4947-aceb-2c82e6e2f550 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.180932 Sep 19 10:40:26.323668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 312/612] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:26 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:26.581207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:26.581820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:26.587839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:26.588374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:26.588842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:26.589566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:26.590018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:26.590446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:26.654472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:26.662942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d6748a4d-3fa2-4512-9518-29bcc1e88e0a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1223 microversion: 2.1 time: 0.085687 Sep 19 10:40:26.663512 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 301/613] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:26 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:27.007088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:27.007690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:27.014443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.014918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.015349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.016031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.016479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.016896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.151413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:27.158885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-27806eae-16da-4944-b61f-4793658acbac tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.155740 Sep 19 10:40:27.159441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 313/614] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:27 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:27.346235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:27.346774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:27.354311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.354796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.355270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.355964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.356421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.356849 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.502535 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:27.511478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8d01c68a-0473-4268-8f02-e45b901fe99f tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.169352 Sep 19 10:40:27.512056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 302/615] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:27 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:27.690885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:27.691496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:27.698038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.698521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.698956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.699668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:27.700109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:27.700548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:27.760630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:27.768804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a8b438b4-89cf-4a69-ac0a-22043234a4c6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1223 microversion: 2.1 time: 0.081768 Sep 19 10:40:27.769418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 314/616] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:27 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:28.182614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:28.183224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:28.190136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.190727 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.191346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.192063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.192519 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.193677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.419257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:28.427098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-57fe3eca-26bd-451f-9b49-b9c0f681a0c0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.248397 Sep 19 10:40:28.432085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 303/617] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:28 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:28.535208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:28.535820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:28.542210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.542912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.543522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.544597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.545530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.545969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.689124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:28.697279 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-83d81e69-21f1-4fd3-9e2b-e49eab1a18f3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.165884 Sep 19 10:40:28.697842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 315/618] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:28 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:28.792101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:28.792707 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:28.798644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.799119 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.799547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.800234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:28.800684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:28.801123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:28.864272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:28.871782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-58f8ae54-9be0-4df3-afca-06bcd4d12e96 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1271 microversion: 2.1 time: 0.083489 Sep 19 10:40:28.872340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 304/619] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:28 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:29.451296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:29.451939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:29.463487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.464148 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.464412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.465149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.466122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.466322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.609408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:29.617688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7a208e9b-2d55-47aa-a705-4b7e5ec0d4be tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.170228 Sep 19 10:40:29.618292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 316/620] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:29 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:29.721190 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:29.721730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:29.728758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.729314 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.729753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.730450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.730903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.731328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.894506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:29.895345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:29.899811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:29.911061 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-51a584dc-47f7-4250-80e7-fc2e78e71b3c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.193962 Sep 19 10:40:29.914759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.929098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 305/621] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:29 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:29.929442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.929442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.929442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:29.929442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:29.929789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:29.992758 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:30.001502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6717681b-3ac0-4774-b5d8-f79862c99743 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1277 microversion: 2.1 time: 0.110928 Sep 19 10:40:30.002086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 317/622] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:29 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:30.642009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:30.642663 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:30.650455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:30.650995 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:30.651495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:30.652283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:30.652768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:30.653272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:30.886538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:30.895065 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6c0e7e3a-8299-4b43-b172-a1dd961ea71a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.257725 Sep 19 10:40:30.895972 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 306/623] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:30 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:30.943272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:30.944464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:30.953125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:30.953919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:30.954508 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:30.955663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:30.956286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:30.957015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:31.026144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:31.026921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:31.034117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:31.034682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:31.035290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:31.036033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:31.036597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:31.037474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:31.137837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:31.149440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-515da57a-db25-485b-bbc7-d1f20f267a86 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.212468 Sep 19 10:40:31.150159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 318/624] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:30 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:31.296043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:31.307345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0ef50560-6fa7-447f-997f-cd5f27ecaf86 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.285672 Sep 19 10:40:31.308232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 307/625] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:31 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:31.507397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd47b18-24ac-4d6d-b644-7341a99ba737", "tag": "69027061-065a-436a-9a39-8e161e811331"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:31.518636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:31.519186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:31.519672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:31.532944 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] Creating event network-changed:69027061-065a-436a-9a39-8e161e811331 for instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 on hv-cinder-85827 Sep 19 10:40:31.537972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-b5717d4e-1d09-41c8-9c76-612f965e9c51 req-b42f9cc3-5830-484b-b8ba-8df0321fa39c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035324 Sep 19 10:40:31.538538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 319/626] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:31.919704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:31.920312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:31.927473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:31.927956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:31.928386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:31.929093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:31.929545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:31.929966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:32.150742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:32.158845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-06ba324b-fd91-458b-a99c-73151734de37 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.243003 Sep 19 10:40:32.159582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 308/627] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:31 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:32.178188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:32.179220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:32.181263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:32.186827 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:32.187402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:32.187908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:32.188672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:32.189278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:32.189794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:32.331979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:32.332828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:32.339619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:32.340124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:32.340617 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:32.341360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:32.341816 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:32.342237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:32.515984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:32.529092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e92407e4-ce52-48bf-a819-97f5516ff235 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.201108 Sep 19 10:40:32.530374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 309/628] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:32 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:32.588621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:32.600095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-46400e7d-6305-44e0-97d8-7faabfde97ab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.426168 Sep 19 10:40:32.600781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 320/629] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:32 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:33.182069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:33.182827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:33.189318 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.189810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.190249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.190939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.191487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.191904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.229394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63471bae-c8d3-4b0d-a78a-662fece52413", "name": "network-vif-plugged", "status": "completed", "tag": "c7008b17-5a50-4d85-96c4-a43efa4cf1f5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:33.239319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.239802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.240234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.244042 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:33.251358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] Creating event network-vif-plugged:c7008b17-5a50-4d85-96c4-a43efa4cf1f5 for instance 63471bae-c8d3-4b0d-a78a-662fece52413 on hv-cinder-85827 Sep 19 10:40:33.256334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-3bcd9525-253f-4e43-9165-2033b328fc00 req-3d2c342f-b520-4834-99f4-148ba658d8ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030773 Sep 19 10:40:33.256942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 321/630] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:33.324763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:33.332409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e20300ce-e399-4165-a123-8119f7a18025 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.154147 Sep 19 10:40:33.333101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 310/631] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:33 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:33.560373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:33.561123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:33.568232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.568708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.569171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.569851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.570300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.570723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.623727 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:33.624249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:33.630674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.631162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.631602 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.632294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:33.632747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:33.633197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:33.701183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:33.709602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4a0bd1e9-46b7-40e2-915f-baec77ae3fa9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.153434 Sep 19 10:40:33.710326 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 322/632] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:33 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:34.040705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:34.050299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4ff05b79-134c-4e6c-8779-09dbd10c425c tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.430412 Sep 19 10:40:34.050944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 311/633] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:33 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:34.356425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:34.357040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:34.364174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:34.364723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:34.365256 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:34.366012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:34.366514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:34.366983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:34.499481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:34.507490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-16f622ee-eae7-4ec3-bcca-9f1ede262adb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.155556 Sep 19 10:40:34.508086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 323/634] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:34 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:34.735299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:34.736087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:34.743611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:34.744169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:34.744677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:34.745542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:34.746069 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:34.746599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:34.888230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:34.896552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-58d9816e-ac5e-4e2e-aa3b-68247719a9f6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.165345 Sep 19 10:40:34.897134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 312/635] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:34 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:35.074173 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:35.074698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:35.080883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.081517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.081950 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:35.082634 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.083086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.084181 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:35.229841 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:35.236397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d8bdf146-1735-4794-83ef-786a85e1eeab tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.166116 Sep 19 10:40:35.237036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 324/636] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:35 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:35.531594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:35.532206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:35.538180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.538661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.539127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:35.539812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.540274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.540730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:35.558756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:35.667819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:35.675919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b9b3dbec-4dd6-4fb5-b9f5-03eeef318343 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1366 microversion: 2.1 time: 0.148329 Sep 19 10:40:35.676490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 313/637] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:35 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:35.919067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:35.919693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:35.921606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=4 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:35.922266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=14 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:35.927480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.927958 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.928394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:35.929100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:35.929562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:35.930011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.066819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:36.074841 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c1a109b6-0e5c-4517-8def-e34734726829 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.159627 Sep 19 10:40:36.075454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 325/638] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:35 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:36.261881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:36.262495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:36.269179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.269655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.270086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.271272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.271729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.272176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.419178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:36.427350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8bcdf7d1-a739-4529-9282-b1144d1ae9ba tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.169556 Sep 19 10:40:36.427907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 314/639] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:36 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:36.636295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:36.636783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:36.643121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.643597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.644026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.644711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.645198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.645622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.674392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-583bfda2-6dfa-49fc-95fd-1bcd9fcdea42 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments/67877a76-5654-4391-930d-9d8636217896" status: 200 len: 194 microversion: 2.20 time: 0.042124 Sep 19 10:40:36.674962 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 326/640] 10.222.0.42 () {60 vars in 1454 bytes} [Mon Sep 19 10:40:36 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments/67877a76-5654-4391-930d-9d8636217896 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:40:36.700248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:36.701189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:36.709177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.709842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.710462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.711300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.711837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.712342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.717203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:36.745566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:36.746161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:36.752243 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.752797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.753348 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.754202 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.754730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.755827 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.849218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'services' on Instance uuid 784aab17-65f2-41da-97ef-e294b0a9713d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:36.853181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:36.861147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9ec1d120-6d16-4156-946b-a192faae73c6 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1556 microversion: 2.1 time: 0.165451 Sep 19 10:40:36.861955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 315/641] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:36 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:36.900360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:36.900852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:36.907234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.907718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.908154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.908845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:36.909368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:36.909792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:36.996053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-484caf18-1dc9-4c43-81dc-6680ef9ff164 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097931 Sep 19 10:40:36.996053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 316/642] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:40:36 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:40:37.078757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8243a1ad-6539-4029-9081-dc43a1407661 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments/67877a76-5654-4391-930d-9d8636217896" status: 202 len: 0 microversion: 2.20 time: 0.336870 Sep 19 10:40:37.080053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 327/643] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Sep 19 10:40:36 2022] DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments/67877a76-5654-4391-930d-9d8636217896 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:40:37.090203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:37.099797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:37.101027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:37.106785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:37.114447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.115570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.116263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.116933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.117525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.118041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.125150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.126021 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.126242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.127101 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.127676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.128174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.186124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-06b74e04-25f1-4a7c-aedf-7b8e32763e65 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.099554 Sep 19 10:40:37.188708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 317/644] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 19 10:40:37 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:40:37.291808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:37.301711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4e49e4e5-41d2-4054-9ccc-0f9f5a940d11 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.206839 Sep 19 10:40:37.303296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 328/645] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:37 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:37.450560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:37.451283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:37.457537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.458100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.458557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.459249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:37.459699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:37.460117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:37.679682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:37.687840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a2e52190-e5ef-4279-b4eb-001db21f9352 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.241389 Sep 19 10:40:37.688405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 318/646] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:37 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:38.176261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63471bae-c8d3-4b0d-a78a-662fece52413", "tag": "c7008b17-5a50-4d85-96c4-a43efa4cf1f5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:38.187048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.187745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.188262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.200814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:38.202507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] Creating event network-changed:c7008b17-5a50-4d85-96c4-a43efa4cf1f5 for instance 63471bae-c8d3-4b0d-a78a-662fece52413 on hv-cinder-85827 Sep 19 10:40:38.203020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:38.208315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-4450b956-e185-42f9-8217-0db9670fdd92 req-34010d83-4f8a-4627-b5d4-d207abd4795a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036095 Sep 19 10:40:38.209656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.210139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.210272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 329/647] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:38.210864 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.211802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.212560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.212983 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.242689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-15bc1ec3-7289-4415-a7b4-93bfccb98ef7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045784 Sep 19 10:40:38.243258 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 319/648] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 19 10:40:38 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 10:40:38.327040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:38.327978 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:38.343533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.348929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.348929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.348929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.348929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.349392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.491718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:38.499502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f070ad20-196a-4c8f-a7ba-754f43b8941f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.176790 Sep 19 10:40:38.509197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 330/649] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:38 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:38.711796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:38.712785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:38.719891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.720628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.721051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.721776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:38.722222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:38.722698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:38.934530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:38.943581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cea21a23-3872-41ad-a176-f1a5cbd9b285 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.236434 Sep 19 10:40:38.944229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 320/650] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:38 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:39.256079 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:39.258352 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:39.265184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.265890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.267520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.268100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.268558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.268970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.304039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1742b829-590b-4a3a-8b42-73e64d311f9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051914 Sep 19 10:40:39.304623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 331/651] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 19 10:40:39 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:39.316297 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd47b18-24ac-4d6d-b644-7341a99ba737", "name": "network-vif-plugged", "status": "completed", "tag": "69027061-065a-436a-9a39-8e161e811331"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:39.326642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.327140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.327548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.339877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] Creating event network-vif-plugged:69027061-065a-436a-9a39-8e161e811331 for instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 on hv-cinder-85827 Sep 19 10:40:39.345051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-75cc3034-23ae-4763-a5bf-89a78da08539 req-5559ffa4-2631-4f05-8992-afb1965aa419 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 Sep 19 10:40:39.347151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 321/652] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:39.378830 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:39.379249 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:39.385428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.385915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.386350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.387055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.387521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.388115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.435227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:40:39.523691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:39.524400 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:39.530894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.531381 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.531893 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.532508 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.532958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.533409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.682984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:39.689864 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5eef3922-348b-465b-947a-6a2297bb605a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.171059 Sep 19 10:40:39.690456 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 322/653] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:39 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:39.797863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f4229369-5ce3-4adf-bfbf-25383086827c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 204 len: 0 microversion: 2.20 time: 0.422547 Sep 19 10:40:39.798465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 332/654] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 19 10:40:39 2022] DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 10:40:39.808028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:39.808716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:39.816295 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.816845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.817369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.818715 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.819254 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.819958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.957170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:39.965453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:39.966901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:39.968064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-060e32ab-6ec2-4429-9f4c-7669358d58be tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.164478 Sep 19 10:40:39.968188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:39.968614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 323/655] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:39 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:39.969053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:39.976104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.976710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.977276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:39.978132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:39.978674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:39.979187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:40.133488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:40.143443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-da61acf1-3068-415e-8b6d-1299e90d3a34 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.180295 Sep 19 10:40:40.144160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 333/656] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:39 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:40.714629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:40.715137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:40.721168 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:40.721628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:40.722057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:40.722734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:40.723180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:40.723604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:40.855798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:40.864117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-983f59b1-e67c-4078-a39c-4eb45b64ca0f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.153423 Sep 19 10:40:40.864716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 324/657] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:40 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:40.994287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:40.994922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:41.001608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.002089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.002518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:41.003200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.003655 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.004075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:41.138135 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:41.147142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:41.148569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:41.149761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5c103964-12b3-4194-8239-7fb2a8b915bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.159557 Sep 19 10:40:41.150321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 334/658] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:40 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:41.171784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:41.172395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:41.178425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.178914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.179347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:41.180033 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.180487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.180910 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:41.331192 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:41.339912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0422ea62-e6cc-4676-8253-96d87185a600 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.172056 Sep 19 10:40:41.340480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 325/659] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:41 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:41.887358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:41.887966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:41.894121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.894595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.895025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:41.895698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:41.896782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:41.897237 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:42.033137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:42.041192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6987efa4-4d0d-4f2c-94f6-9de1104e77a6 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.157639 Sep 19 10:40:42.041760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 335/660] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:41 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:42.174915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:42.175527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:42.182149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:42.182658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:42.183090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:42.183777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:42.184229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:42.184646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:42.311480 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:42.320304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:42.321773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:42.322931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a2e1a0d7-3fb0-4a1e-b2ed-c139ccb421df tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.151994 Sep 19 10:40:42.323483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 326/661] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:42 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:42.363221 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:42.363860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:42.369877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:42.370356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:42.370793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:42.371480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:42.371934 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:42.372360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:42.542971 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:42.546675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:42.551750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f49dad0c-d4fe-4e54-9ed0-69100157e760 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.192476 Sep 19 10:40:42.552353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 336/662] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:42 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:43.066226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:43.066833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:43.073587 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.074064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.074489 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.078122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.078122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.078122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.269015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:43.278102 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-65e1f10c-c09f-483b-bedb-7e8fd4593aab tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1319 microversion: 2.1 time: 0.215953 Sep 19 10:40:43.278759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 327/663] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:43 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:43.351308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:43.351908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:43.358880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.359364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.359798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.360497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.360946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.361450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.510769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:43.520936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:43.523619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:43.525301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-33b2d545-334a-4fb0-9072-3be1ee398956 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1724 microversion: 2.20 time: 0.178268 Sep 19 10:40:43.526099 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 337/664] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:43 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:40:43.575473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:43.576743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:43.585000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.585690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.586132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.586833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:43.587282 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:43.587702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:43.860212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:43.870540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-33e56b7d-c43d-40ee-8bfe-1f468e328c03 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1756 microversion: 2.1 time: 0.298819 Sep 19 10:40:43.873134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 328/665] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:43 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1756 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:40:44.076524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784aab17-65f2-41da-97ef-e294b0a9713d", "name": "network-vif-deleted", "tag": "9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:44.100132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.100801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.101180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.121366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] Creating event network-vif-deleted:9d0d2ec1-9b56-42b2-936d-25b7ba62a8a6 for instance 784aab17-65f2-41da-97ef-e294b0a9713d on hv-cinder-85827 Sep 19 10:40:44.130469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-b17dba15-bba8-4d09-b05f-50aade022b89 req-93535846-f5fe-41a6-a53d-6f761e303696 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069828 Sep 19 10:40:44.132892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 338/666] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:44.302956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:44.303482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:44.308800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:44.312979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.313547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.313986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.314709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.315163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.315590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.458605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:44.466714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5bc322b3-842c-4666-b6b8-c42062f26c33 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1509 microversion: 2.1 time: 0.167626 Sep 19 10:40:44.467291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 329/667] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:44 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:44.557794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:44.559462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:44.568644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.569419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.570088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.571007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.571654 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.572382 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.608964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.609619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.610196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.610807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'fault' on Instance uuid 784aab17-65f2-41da-97ef-e294b0a9713d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:44.662831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:44.672101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:44.673766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:44.675081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8cf08bc8-33b2-49d6-a377-6f9d5219d383 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1371 microversion: 2.20 time: 0.127391 Sep 19 10:40:44.675692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 339/668] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:44 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1371 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:44.895191 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:44.895828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:44.902581 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.903060 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.903545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:44.904247 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:44.904698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:44.905203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:45.068219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:45.076725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4d89987c-c7c8-4b3d-8a0a-d3e5d9341068 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1759 microversion: 2.1 time: 0.185830 Sep 19 10:40:45.077332 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 330/669] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:40:44 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:40:45.703347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:45.704247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:45.711298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:45.711775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:45.712317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:45.712998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:45.713478 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:45.713901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:45.750418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:45.751204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:45.752031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:45.752853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'fault' on Instance uuid 784aab17-65f2-41da-97ef-e294b0a9713d {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:40:45.794420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:45.803086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:45.804511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:45.805793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-606d865b-4460-473f-b911-40f685527e9a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 200 len: 1371 microversion: 2.20 time: 0.107101 Sep 19 10:40:45.806346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 340/670] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:45 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:40:46.830348 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:46.830956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:46.837682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:46.838157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:46.838585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:46.839262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:46.839711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:46.840158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:46.854496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d HTTP/1.1 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:40:46.856178 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:40:46.857847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '784aab17-65f2-41da-97ef-e294b0a9713d'} Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:40:46.858726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:40:46.859952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:40:46.861046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:40:46.861046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-be98ff2b-6a62-47d0-8e1b-a9e16463debd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 404 len: 111 microversion: 2.20 time: 0.031150 Sep 19 10:40:46.861046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 331/671] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:46 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 19 10:40:46.867089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f80b0951-7ed2-4c74-b119-db20726da0d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '.version_select at 0x7fb943064a60>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:46.940062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f80b0951-7ed2-4c74-b119-db20726da0d0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215666882" status: 204 len: 0 microversion: 2.20 time: 0.077134 Sep 19 10:40:46.940666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 341/672] 10.222.0.42 () {60 vars in 1262 bytes} [Mon Sep 19 10:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215666882 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 10:40:47.763641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a0fa598e-1ec7-4a30-9967-8bfeebf36f81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: .version_select at 0x7fb943224820>, body: {"keypair": {"name": "tempest-keypair-959923239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIoBPJaaShbqfnnMVNnQ6gOcCDkxmDYLYllbFHKfDWg7IBtov0/jfNxzHIeO8j/o0H5DScc8SQ6IQ4HKCVNGA9D17esx1w+6jWJZ9quQ7TH03rwcgfGrhHZQFGuzQrEnw=="}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:47.779777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-a0fa598e-1ec7-4a30-9967-8bfeebf36f81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for project e3160b641b81433780d38eca696bfdf1. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:40:47.783766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-a0fa598e-1ec7-4a30-9967-8bfeebf36f81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for user d4d9bea213fa4401992d8e7894726e05 and project e3160b641b81433780d38eca696bfdf1. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:40:47.908404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a0fa598e-1ec7-4a30-9967-8bfeebf36f81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.148753 Sep 19 10:40:47.909080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 332/673] 10.222.0.42 () {62 vars in 1200 bytes} [Mon Sep 19 10:40:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 150 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 10:40:50.428203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2043789540", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4b8524c-7971-4971-b615-0e1396b631d7"}], "security_groups": [{"name": "tempest-securitygroup--1081838704"}], "key_name": "tempest-keypair-959923239", "user_data": "}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:50.540421 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] validate_networks() for [('d4b8524c-7971-4971-b615-0e1396b631d7', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:40:50.943576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:40:50.944047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:40:50.944522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:40:50.944928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:40:50.945384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:40:50.954301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:50.954789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:50.955254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:50.955986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:50.956441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:50.956854 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:50.974586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for project e3160b641b81433780d38eca696bfdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:40:50.979175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Getting quotas for user d4d9bea213fa4401992d8e7894726e05 and project e3160b641b81433780d38eca696bfdf1. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:40:50.991021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:40:50.993340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:40:51.191132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2706fa8b-9442-4fae-a400-0e09ebae3164 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.767876 Sep 19 10:40:51.196263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 342/674] 10.222.0.42 () {62 vars in 1188 bytes} [Mon Sep 19 10:40:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 10:40:51.203895 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:51.204514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:51.267193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:51.276177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:51.278045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:51.279625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9d837eca-64ed-4664-955c-cacfd65125c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1281 microversion: 2.20 time: 0.079688 Sep 19 10:40:51.280462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 333/675] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:51 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:40:52.197838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed944c6b-599d-45e1-9a7b-25c437727214"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:52.201346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:52.207604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:52.208125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:52.209190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:52.209882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:52.210356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:52.210776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:52.310871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:52.311724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:52.319465 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:52.322403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:52.322403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:52.322403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:52.322403 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:52.322771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:52.389424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:52.400646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:52.402021 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:52.403131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d4b090ce-7ab5-4081-a0db-69651445bade tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1285 microversion: 2.20 time: 0.096579 Sep 19 10:40:52.403683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 334/676] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:52 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:40:53.139554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d1a0c724-ec49-47fd-97ee-6d980f9281cf tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946885 Sep 19 10:40:53.143580 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 343/677] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:40:52 2022] POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments => generated 194 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:53.428272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:53.428917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:53.435596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:53.436093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:53.436530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:53.437275 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:53.437733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:53.438159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:53.457097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:40:53.503486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:53.511808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:53.513281 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:53.514387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b57a5e9a-58ae-4c3c-b988-023ef8d0f346 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1333 microversion: 2.20 time: 0.090647 Sep 19 10:40:53.514933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 335/678] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:53 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:54.540155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:54.540771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:54.552213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:54.553128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:54.554037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:54.555680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:54.556356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:54.557351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:54.626259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:54.635440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:54.637199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:54.638308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6fdb0a38-a3e6-42dc-a50d-30f1d843ed8e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1339 microversion: 2.20 time: 0.102919 Sep 19 10:40:54.638851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 344/679] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:54 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:55.688387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:55.689305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:55.698859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:55.699715 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:55.700300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:55.701445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:55.702050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:55.702822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:55.929574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:55.939518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:55.941161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:55.942352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ffe28bc3-562a-48dd-9ae8-ce9e370b7303 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.260204 Sep 19 10:40:55.943265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 336/680] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:55 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:56.183232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:40:56.195510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:56.201207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:56.201207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:56.211586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] Creating event network-changed:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:40:56.216732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-8d5542b2-168b-44a5-89cc-63f108db2ed3 req-ff8886a8-cc42-47d7-a51b-0ee069de914a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037115 Sep 19 10:40:56.217705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 345/681] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:40:56.967711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:56.968389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:56.975184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:56.975852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:56.976355 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:56.977160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:56.977680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:56.978183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:57.144127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:57.152712 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:57.154184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:57.155367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d5210b8d-cf8f-4875-b9fa-b39811b0f301 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.191617 Sep 19 10:40:57.155935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 337/682] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:56 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:58.182026 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:58.182752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:58.190849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:58.191564 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:58.192344 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:58.193240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:58.193696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:58.194368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:58.351477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:58.362372 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:58.363792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:58.364913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-89168fe2-eba8-4e9d-a85c-1b16e1cb2e0a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.187880 Sep 19 10:40:58.365504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 346/683] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:58 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:40:59.393513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:40:59.394162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:40:59.401392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:59.401873 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:59.402303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:59.403005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:40:59.403456 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:40:59.403875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:40:59.538770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:59.547650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:59.549147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:40:59.550308 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3aa543da-a353-4261-b6bb-74f0dccb4fa4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.161098 Sep 19 10:40:59.554019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 338/684] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:40:59 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:41:00.575308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:00.576025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:00.582568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:00.583053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:00.583562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:00.584299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:00.584749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:00.585210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:00.714615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:00.725047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:00.726511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:00.727613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-58160f70-2da3-4f62-a2e2-eba7ef08465c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.156355 Sep 19 10:41:00.728166 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 347/685] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:00 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:41:01.751751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:01.752446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:01.754883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:01.760235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:01.760723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:01.761188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:01.761890 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:01.762340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:01.762756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:01.806532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:01.808824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:01.814265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:01.814265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:01.817015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:01.817525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:01.817986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:01.818730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:01.819178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:01.819811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:01.848697 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'flavor' on Instance uuid 041b4a5e-774b-4a16-8082-d884ff033f63 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:01.897265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:01.905373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:01.906801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:01.907907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-26911339-5f51-4f5a-b566-473f1a89731d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.160048 Sep 19 10:41:01.908464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 339/686] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:01 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:41:02.207476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a9306dd5-a868-4b4a-aa40-1ba3f290b1ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/action" status: 200 len: 32 microversion: 2.1 time: 0.404856 Sep 19 10:41:02.208178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 348/687] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:41:01 2022] POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 10:41:02.221135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:02.221744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:02.227812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:02.228290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:02.228719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:02.231004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:02.231004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:02.231004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:02.407268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:02.415545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-96ee7a24-6252-4c1e-8fe3-5de619452744 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.198520 Sep 19 10:41:02.416136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 340/688] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:02 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:02.936147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:02.936938 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:02.940156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:02.944137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:02.944740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:02.945312 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:02.946129 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:02.946610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:02.947331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.087599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:03.097509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:03.099964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:03.101095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f5b1e7b-a5ae-4e84-b52d-1f39c4b01d24 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.170204 Sep 19 10:41:03.101644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 349/689] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:02 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:41:03.358030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "433ee418-7ce6-4be1-8346-3bda4fc55a30", "device": "/dev/sdb"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:03.361195 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:03.367905 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:03.368422 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:03.368852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.369632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:03.370088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:03.370525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.441418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:03.442240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:03.451810 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:03.452297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:03.452728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.453454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:03.453904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:03.454329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.592969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:03.601545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-85b62abc-3f7f-4a94-b7c3-482c83685fbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.165502 Sep 19 10:41:03.602109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 350/690] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:03 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:03.606616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "name": "network-vif-plugged", "status": "completed", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:03.615480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:03.616073 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:03.616808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:03.627552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] Creating event network-vif-plugged:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:41:03.632858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-f9f445c5-debd-46f6-b69a-a33182d562c4 req-532531e2-fa28-4971-b400-575a38876aee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029593 Sep 19 10:41:03.633544 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 351/691] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:04.127212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:04.127957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:04.134773 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:04.135253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:04.135687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:04.136374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:04.136822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:04.137273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:04.202413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ea55df34-2660-41da-be26-3fa6bad81408 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "POST /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848143 Sep 19 10:41:04.203043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 341/692] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:41:03 2022] POST /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:04.287236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:04.296644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:04.298802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:04.299907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-28eb9b53-43fe-4ed1-a45b-a9f4d09fa258 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.177472 Sep 19 10:41:04.300469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 352/693] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:04 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:41:04.626828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:04.627550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:04.634283 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:04.634939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:04.635257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:04.636211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:04.636670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:04.637134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:04.769263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:04.778151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-05a9b91e-8a64-4d5f-8088-870d19d6d355 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.155780 Sep 19 10:41:04.778711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 342/694] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:04 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:05.325983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:05.329987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:05.333290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:05.334666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:05.335109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:05.335839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:05.336293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:05.336765 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:05.340860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:05.469369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:05.478695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:05.480420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:05.481783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d0aaff99-05e9-4f2a-9c75-820432f2a2a3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1407 microversion: 2.20 time: 0.159819 Sep 19 10:41:05.482431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 353/695] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:05 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:41:05.801787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:05.802469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:05.809250 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:05.809800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:05.810298 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:05.811054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:05.811569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:05.812049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:05.951142 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:05.963352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-965bdcf2-7cb3-4cac-b6ad-d7963ece504b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.165813 Sep 19 10:41:05.964012 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 343/696] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:05 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:06.508102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:06.508641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:06.515121 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.515595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.516282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:06.517009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.517480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.517899 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:06.655295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:06.663568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:06.665126 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:06.666261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ba59adb9-602d-4a27-8301-5e24f29976c3 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1600 microversion: 2.20 time: 0.163176 Sep 19 10:41:06.666840 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 354/697] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:41:06 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:41:06.691020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:06.691511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:06.697969 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.698450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.698891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:06.699578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.700030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.700454 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:06.778611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6213a435-5893-4d1b-9eca-a43d89411918 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091464 Sep 19 10:41:06.779203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 344/698] 10.222.0.42 () {60 vars in 1316 bytes} [Mon Sep 19 10:41:06 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:41:06.986896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:06.987497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:06.993523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.994037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.994491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:06.995175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:06.995626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:06.996041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:07.138080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:07.148525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-726b4c65-e534-429a-b14a-78a6f27742e1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.165462 Sep 19 10:41:07.149406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 355/699] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:06 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:08.080419 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:08.091093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:08.091569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:08.092002 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:08.103129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] Creating event network-changed:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:41:08.107808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-7bd9fbe3-2a34-4022-b9c6-5d213c483a09 req-120d32a5-d54a-4e74-ba43-2a31a7188739 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030975 Sep 19 10:41:08.108640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 345/700] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:08.172357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:08.182019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:08.190721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:08.191220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:08.194081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:08.194081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:08.194081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:08.194081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:08.343746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:08.360683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c60e1c52-37bf-4341-9b78-50cd4c1c57d7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.186956 Sep 19 10:41:08.360683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 356/701] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:08 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:09.383769 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:09.384463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:09.390751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:09.391552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:09.391936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:09.392628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:09.393100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:09.393532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:09.541110 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:09.549400 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0418754c-09d1-4ffc-9162-c0e719e328c1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.170387 Sep 19 10:41:09.550132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 346/702] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:09 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:10.574036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:10.574762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:10.582713 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:10.583286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:10.584311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:10.585143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:10.585705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:10.586244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:10.729642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:10.740255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-62f33cca-7476-40d2-8810-7c94a96885fc tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.170879 Sep 19 10:41:10.740897 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 357/703] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:10 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:11.765487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:11.766379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:11.773503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:11.773987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:11.774429 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:11.775117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:11.775568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:11.775993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:11.919675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:11.928610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5b331a05-d735-4fc5-94bc-11c40a0296cd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.166987 Sep 19 10:41:11.929229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 347/704] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:11 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:12.953598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:12.954277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:12.961353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:12.961830 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:12.962315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:12.963041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:12.963487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:12.963926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:13.092803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:13.101720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2293d6cc-9a47-4dc5-8d2d-deaf5bc77ead tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.152083 Sep 19 10:41:13.102280 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 358/705] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:12 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:14.125119 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:14.125720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:14.132640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.133152 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.133592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.134299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.134752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.135174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.266796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:14.284366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9ec9c9ea-2be9-4556-bb46-adc63f458cd9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.157218 Sep 19 10:41:14.284366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 348/706] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:14 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:14.295359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:14.297833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:14.304554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.305042 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.305517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.306213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.306668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.307107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.337005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-eceba1c5-399f-4aa6-ae3a-a9b1aacabb90 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045673 Sep 19 10:41:14.337710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 359/707] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:14 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:41:14.400894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:14.401495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:14.408231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.408710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.409164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.409854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.410304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.410781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.436066 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:41:14.808314 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-76377e44-c47e-4708-9f86-3efec4070787 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 204 len: 0 microversion: 2.1 time: 0.411152 Sep 19 10:41:14.809160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 349/708] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:41:14 2022] DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:41:14.817598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:14.818776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:14.825365 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.825843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.826700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.826943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:14.827410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:14.827869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:14.959659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:14.967706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f8bbf1d-05f5-4597-a4da-7a1fba1e64a3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.153982 Sep 19 10:41:14.968311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 360/709] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:14 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:15.302928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:15.303639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:15.306241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:15.311516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:15.312058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:15.312543 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:15.313342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:15.313853 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:15.319735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:15.319735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:15.457899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:15.467153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-18c1d3ae-ec5b-4497-9a94-aaab90a35e38 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.168970 Sep 19 10:41:15.467782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 350/710] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:15 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:15.992888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:15.993519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:15.999925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:16.000403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:16.000835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:16.001560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:16.002012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:16.002432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:16.132549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:16.141752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f7f59e6e-f77a-451b-b9c4-c3ed2b78f696 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.152996 Sep 19 10:41:16.142471 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 361/711] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:15 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:16.497385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:16.498800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:16.510431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:16.511324 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:16.512053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:16.513194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:16.513858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:16.514487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:16.685038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:16.691140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-446a48a9-0d17-4add-b453-de494cbe9310 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.200740 Sep 19 10:41:16.691700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 351/712] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:16 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:17.169684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:17.170425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:17.179489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:17.179979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:17.180425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:17.181153 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:17.181617 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:17.182063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:17.314543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:17.322482 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c1da21aa-6c91-4611-ab23-18130f1bd505 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.157109 Sep 19 10:41:17.323052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 362/713] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:17 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:17.716342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:17.717048 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:17.724710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:17.725290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:17.725782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:17.726564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:17.727070 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:17.727546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:17.868499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:17.876960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1b908070-7b2e-45e4-a670-7fcb79c292d9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.164975 Sep 19 10:41:17.877564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 352/714] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:17 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:18.346454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:18.347161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:18.354805 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:18.355346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:18.355787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:18.356471 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:18.356916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:18.357423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:18.613539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:18.621428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4c813740-123a-4f2f-96aa-3358b20d624c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.278867 Sep 19 10:41:18.622014 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 363/715] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:18 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:18.901974 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:18.902574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:18.909087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:18.909574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:18.910003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:18.910686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:18.911135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:18.912154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:19.045781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:19.055187 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4e2ac89f-2bb6-479e-b590-d841817f043b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.156738 Sep 19 10:41:19.055623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 353/716] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:18 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:19.645733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:19.646868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:19.653280 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:19.653762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:19.654200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:19.654886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:19.655342 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:19.655766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:19.783883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:19.794254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4c0cc5c1-84f3-4486-b623-e0941877ecce tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.152590 Sep 19 10:41:19.794826 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 364/717] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:19 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:20.079655 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:20.080284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:20.087352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:20.087828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:20.088310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:20.089049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:20.089505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:20.089961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:20.273129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:20.281869 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bbca7922-0536-4852-8516-4089e59a3f01 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.206290 Sep 19 10:41:20.282485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 354/718] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:20 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:20.819183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:20.819798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:20.826655 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:20.826804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:20.827124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:20.827818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:20.828271 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:20.828698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:20.961871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:20.969441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-edf5172d-6c94-4142-b528-2ffa5ffead0c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.155806 Sep 19 10:41:20.970002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 365/719] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:20 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:21.305786 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:21.306389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:21.312775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:21.313292 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:21.313741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:21.314392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:21.314833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:21.315248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:21.450226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:21.458992 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b6422e36-c532-4af5-b787-4d43d442eb6c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.157770 Sep 19 10:41:21.459656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 355/720] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:21 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:21.994337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:21.994937 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:22.001404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:22.001886 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:22.002321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:22.003008 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:22.003463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:22.003890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:22.134486 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:22.142525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f1b39a3-082e-4454-a0e9-733c6b45d500 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.152052 Sep 19 10:41:22.143091 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 366/721] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:21 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:22.485961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:22.486614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:22.493950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:22.503836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:22.503836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:22.503836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:22.503836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:22.504221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:22.628632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:22.641224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-82d5e3e6-340e-4d51-869d-25ce03402b13 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.156779 Sep 19 10:41:22.641224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 356/722] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:22 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:23.167314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:23.168844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:23.175778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:23.180053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:23.180053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:23.180053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:23.180053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:23.180425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:23.318516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:23.323032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d9e644ab-ce9e-4282-a08a-09193376876b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1674 microversion: 2.1 time: 0.160017 Sep 19 10:41:23.323742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 367/723] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:23 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:23.666141 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:23.678862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:23.678862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:23.678862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:23.678862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:23.679234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:23.679234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:23.679234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:23.872684 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:23.884789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e7b38b88-c4f9-4936-9a1a-d7aacf3d45b0 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.218941 Sep 19 10:41:23.884789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 357/724] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:23 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:24.026708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa2a3428-631d-490f-8f6b-23b4a1b0c30e", "name": "network-vif-deleted", "tag": "30e156f6-3b5b-49b1-b29a-66c1049d478b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:24.038463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:24.039356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:24.040156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:24.053804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] Creating event network-vif-deleted:30e156f6-3b5b-49b1-b29a-66c1049d478b for instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e on hv-cinder-85827 Sep 19 10:41:24.060074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-a715f425-4632-4615-a0c0-749543f7a73f req-9208917b-49ce-4df4-b3a2-bd621b71361c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Sep 19 10:41:24.060589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 368/725] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:24.347615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:24.348538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:24.355827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:24.356462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:24.356949 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:24.357736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:24.358285 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:24.358749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:24.429212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:24.438477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7ab163d5-118e-4dca-81a5-5df88296b386 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1607 microversion: 2.1 time: 0.095143 Sep 19 10:41:24.439140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 358/726] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:24 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1607 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:24.904961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:24.905747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:24.912942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:24.913573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:24.914093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:24.914948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:24.915484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:24.916018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:25.054883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:25.064077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fd7421b3-9010-466b-b73e-d2004d55797f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.163898 Sep 19 10:41:25.064718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 369/727] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:24 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:25.465137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:25.465745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:25.472229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:25.472708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:25.473169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:25.473865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:25.474319 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:25.474742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:25.540795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:25.548796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e9cff93d-eddb-46fe-bc43-1838c8a6f4b5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1607 microversion: 2.1 time: 0.087562 Sep 19 10:41:25.549453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 359/728] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:25 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:26.089517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:26.090034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:26.096399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:26.096876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:26.097345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:26.098025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:26.098472 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:26.098890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:26.118153 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:26.226802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:26.234856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-26746c84-6b1a-45d1-bef4-c813811eef7b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.149208 Sep 19 10:41:26.235422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 370/729] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:26 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:26.572483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:26.573170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:26.579509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:26.579986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:26.580415 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:26.581118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:26.581571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:26.581992 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:26.643654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:26.652744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-87ba7388-a26d-46fc-b2b0-4a5e73ac0079 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1607 microversion: 2.1 time: 0.084520 Sep 19 10:41:26.653471 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 360/730] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:26 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1607 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:27.259233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:27.259897 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:27.267352 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:27.267888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:27.268377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:27.269194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:27.269703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:27.270180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:27.415355 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:27.423485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6fe49118-73dc-4eff-b742-79fa5d368a6a tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.168677 Sep 19 10:41:27.424057 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 371/731] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:27 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:27.675917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:27.676582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:27.683686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:27.684198 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:27.684662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:27.685388 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:27.685863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:27.686281 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:27.719249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:27.719729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:27.720234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:27.720733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'fault' on Instance uuid fa2a3428-631d-490f-8f6b-23b4a1b0c30e {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:27.765012 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:27.773165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-254741d4-8eee-413e-8b2c-869aa24753e3 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1328 microversion: 2.1 time: 0.101202 Sep 19 10:41:27.773733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 361/732] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:27 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:28.448027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:28.449309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:28.456631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:28.457169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:28.459154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:28.459154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:28.459154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:28.459495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:28.598052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:28.607640 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6e9c4bad-23a0-4ee2-95b0-d877b1b34624 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1735 microversion: 2.1 time: 0.163850 Sep 19 10:41:28.608273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 372/733] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:28 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:28.799460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:28.800351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:28.807622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:28.808041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:28.808467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:28.809181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:28.809631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:28.810055 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:28.851153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:28.851796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:28.852339 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:28.852871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'fault' on Instance uuid fa2a3428-631d-490f-8f6b-23b4a1b0c30e {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:28.899155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:28.907557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a4bb1393-cfe8-4d9a-94d1-91e969687cfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1328 microversion: 2.1 time: 0.113809 Sep 19 10:41:28.908157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 362/734] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:28 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1328 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:29.635147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:29.635976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:29.644142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.644791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.645473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.647211 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.647768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.648293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.789750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:29.799757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-acea5295-2fb8-4258-96d9-91c524fc844c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1715 microversion: 2.1 time: 0.170409 Sep 19 10:41:29.800558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 373/735] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:29 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:29.910475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:29.910974 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:29.917349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.917827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.918257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.918937 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.919386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.920009 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.933330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:29.934100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:29.940902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.941490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.942040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.943584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.944360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.944872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.981884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:29.982445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:29.982973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:29.983700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'fault' on Instance uuid fa2a3428-631d-490f-8f6b-23b4a1b0c30e {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:30.039074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:30.047544 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-84f48733-ed9a-4a42-9c56-3080000d58b7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 200 len: 1328 microversion: 2.1 time: 0.120030 Sep 19 10:41:30.048117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 374/736] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:29 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:30.069660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] HTTP exception thrown: Cannot 'detach_volume' instance 041b4a5e-774b-4a16-8082-d884ff033f63 while it is in vm_state rescued Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Request method failure captured: Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments/ed944c6b-599d-45e1-9a7b-25c437727214 HTTP/1.1 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEaAEpWevJa7FpLX7Feyysk1znYHiXN_UdOa63ocETlcpKwqN8cTVL0dgsXQO8sjKztfasagkAwf8Wf_696lM3XkDHU-IiVZ5yV4jovAb0ss4WnYBNDp8Vx53cnDNU6dEyLE8dRy__skRRa6____BiRE8m3UEqvs46_DSFt41SmIJWs Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:41:30.071482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af388d6e63d641528e8f00de41c59490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af388d6e63d641528e8f00de41c59490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}] Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d3235496c38249a388e4afc263eadbc3 Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:41:30.072811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Cannot 'detach_volume' instance 041b4a5e-774b-4a16-8082-d884ff033f63 while it is in vm_state rescued Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'server_id': '041b4a5e-774b-4a16-8082-d884ff033f63', 'id': 'ed944c6b-599d-45e1-9a7b-25c437727214'} Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:41:30.073527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 041b4a5e-774b-4a16-8082-d884ff033f63 while it is in vm_state rescued Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 041b4a5e-774b-4a16-8082-d884ff033f63 while it is in vm_state rescued Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:41:30.074984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Returning 409 to user: Cannot 'detach_volume' instance 041b4a5e-774b-4a16-8082-d884ff033f63 while it is in vm_state rescued {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:41:30.076041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c544c12f-cb35-4d71-a05a-2ec9e9d732f9 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments/ed944c6b-599d-45e1-9a7b-25c437727214" status: 409 len: 152 microversion: 2.1 time: 0.168198 Sep 19 10:41:30.076041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 363/737] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:41:29 2022] DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments/ed944c6b-599d-45e1-9a7b-25c437727214 => generated 152 bytes in 170 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 10:41:30.084754 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:30.085487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:30.092951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:30.093565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:30.093991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:30.094692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:30.095143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:30.095872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:30.304219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9be80e53-1140-4374-93ae-8d4ad3e12569 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/action" status: 202 len: 0 microversion: 2.1 time: 0.223867 Sep 19 10:41:30.308265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 375/738] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:41:30 2022] POST /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:41:30.314601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:30.315413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:30.323559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:30.324252 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:30.324774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:30.325690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:30.326266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:30.326825 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:30.469341 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:30.478200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c2ca3710-dff9-4734-862b-a8c57b06f3c6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1723 microversion: 2.1 time: 0.168488 Sep 19 10:41:30.478764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 364/739] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:30 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:31.080732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:31.081396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:31.089185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.089696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.090136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.091058 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.091333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.091849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.108883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e HTTP/1.1 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:41:31.110566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:41:31.112190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'fa2a3428-631d-490f-8f6b-23b4a1b0c30e'} Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:41:31.113481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:41:31.114951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:31.116227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:41:31.116227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5fceea0a-a60e-4800-828f-dc4e2a3756f2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 404 len: 111 microversion: 2.1 time: 0.035660 Sep 19 10:41:31.116227 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 376/740] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:31 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:41:31.121731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2f64c6fe-d2ec-4cf3-988d-d4c88c8191dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '.version_select at 0x7fb9431dac10>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:31.212036 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2f64c6fe-d2ec-4cf3-988d-d4c88c8191dd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982888113" status: 202 len: 0 microversion: 2.1 time: 0.094483 Sep 19 10:41:31.214326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 365/741] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 19 10:41:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982888113 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:41:31.278832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:31.279318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:31.287872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.288730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.289215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.290114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.290739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.291359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.389191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lazy-loading 'services' on Instance uuid 4fd47b18-24ac-4d6d-b644-7341a99ba737 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:31.501927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:31.502616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:31.509829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.510364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.510857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.511650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:31.512153 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:31.512620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:31.627259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f5dda48b-82d8-4ace-934b-e1ee09f61272 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737/os-volume_attachments/433ee418-7ce6-4be1-8346-3bda4fc55a30" status: 202 len: 0 microversion: 2.1 time: 0.352117 Sep 19 10:41:31.627915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 377/742] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:41:31 2022] DELETE /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737/os-volume_attachments/433ee418-7ce6-4be1-8346-3bda4fc55a30 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:41:31.812030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:31.822722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-29ac4c78-8116-45ea-bdc7-170e752e5536 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1723 microversion: 2.1 time: 0.325001 Sep 19 10:41:31.827064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 366/743] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:31 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:32.213053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-02604385-4af1-4eb0-8ed1-fb986432ecfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: .version_select at 0x7fb9440f5f70>, body: {"keypair": {"name": "tempest-keypair-456493980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE30n7rIfpT1po+5DC8Hdka4bxoSKRDOqWoatrT171i0nIGDu2RC4yAWHXRsWYZHMqhH8A/spAIW2PhUs0//WWrDcQWyzI8iaMDlQUWWMUAMKLnYgjhyCm6aUIzmin7Dg=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:32.229573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-02604385-4af1-4eb0-8ed1-fb986432ecfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for project 67ec80c3417443d7b2368506bbd4a814. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:41:32.233609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-02604385-4af1-4eb0-8ed1-fb986432ecfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for user 6712334ebb77462daa89be58d4480846 and project 67ec80c3417443d7b2368506bbd4a814. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:41:32.348383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-02604385-4af1-4eb0-8ed1-fb986432ecfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141036 Sep 19 10:41:32.349075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 378/744] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:41:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:32.848080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:32.848680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:32.855572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:32.856089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:32.856510 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:32.857234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:32.857689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:32.858106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:32.862073 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=100 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:32.994268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:33.003206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-dc7b42e8-c49b-464e-954c-6a70ac7c8fd5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1723 microversion: 2.1 time: 0.159060 Sep 19 10:41:33.003889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 367/745] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:32 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:34.028373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:34.029160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:34.031138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:34.036538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:34.037016 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:34.037471 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:34.038153 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:34.038599 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:34.039019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:34.254177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:34.263687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-be74b72a-9737-440b-abe3-d1d4aad01aba tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1723 microversion: 2.1 time: 0.239811 Sep 19 10:41:34.264396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 379/746] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:34 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:34.921544 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1183325837", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b051f35e-e823-4944-b5dc-45fc6f19108b"}], "security_groups": [{"name": "tempest-securitygroup--316137447"}], "key_name": "tempest-keypair-456493980", "user_data": "}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:35.028562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] validate_networks() for [('b051f35e-e823-4944-b5dc-45fc6f19108b', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:41:35.288538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:35.289156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:35.296168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.296685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.297184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.297903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.298403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.298832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.415973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:41:35.416495 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:41:35.417147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:41:35.422433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:41:35.422433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:41:35.429452 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.430129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.430705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.431647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.432372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.432933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.434874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:35.443645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2080c253-dd64-40fa-a1e5-c2df0acf024f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1729 microversion: 2.1 time: 0.159215 Sep 19 10:41:35.444216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 380/747] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:35 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:35.454086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for project 67ec80c3417443d7b2368506bbd4a814. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:41:35.458957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Getting quotas for user 6712334ebb77462daa89be58d4480846 and project 67ec80c3417443d7b2368506bbd4a814. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:41:35.467972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:35.468506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:35.472045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:41:35.474451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.474929 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.475227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:41:35.475362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.476051 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.476498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.476922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:35.559558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2c192942-cc7e-4cd4-b610-95e86596a596 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095347 Sep 19 10:41:35.560189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 381/748] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:41:35 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:35.677488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ce3fc807-689a-4cac-8f87-989b1fe93b4d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759999 Sep 19 10:41:35.678287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 368/749] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:41:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:41:35.690346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e7b61f4d-f369-4a1f-a2e2-00e11c1cf56c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:35.691309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e7b61f4d-f369-4a1f-a2e2-00e11c1cf56c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:35.775860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e7b61f4d-f369-4a1f-a2e2-00e11c1cf56c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:35.784537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e7b61f4d-f369-4a1f-a2e2-00e11c1cf56c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1237 microversion: 2.1 time: 0.098350 Sep 19 10:41:35.785515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 382/750] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:35 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:35.989575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:35.990327 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:35.998079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:35.998722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:35.999280 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.000107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.000730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.001277 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.030231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:41:36.313264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0875c3fc-bbad-40e9-839c-ba4c8ef97133 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 204 len: 0 microversion: 2.1 time: 0.328216 Sep 19 10:41:36.313955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 369/751] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:41:35 2022] DELETE /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:41:36.322107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:36.322722 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:36.329419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.329901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.330357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.331035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.331489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.331910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.483127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:36.491598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-77dea465-e8a1-48af-b0b7-64ea9e5f9e08 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1515 microversion: 2.1 time: 0.173284 Sep 19 10:41:36.492169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 383/752] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:36 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:36.812488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:36.813309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:36.823004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.823487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.824081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.824810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.825348 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.825842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.876029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:36.887503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:36.888449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:36.889511 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:36.905207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:36.911154 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] Creating event network-changed:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:41:36.913988 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-d42716c8-75f7-459e-92ee-5ecf1e4d6a79 req-5420f785-1814-41c3-a587-38b93ed72eb9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045370 Sep 19 10:41:36.914936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 384/753] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:36.915234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-74f92791-4a10-4d26-8579-f2623d5d0232 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1241 microversion: 2.1 time: 0.108676 Sep 19 10:41:36.915831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 370/754] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:36 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:37.516006 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:37.516696 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:37.523966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:37.524449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:37.524874 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:37.525591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:37.526040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:37.526481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:37.667440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:37.676435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ba39909b-b4bb-4fb3-8de1-5b6720b4487d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1515 microversion: 2.1 time: 0.165130 Sep 19 10:41:37.677010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 385/755] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:37 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:37.937349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:37.937961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:37.944374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:37.944854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:37.945325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:37.946015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:37.946465 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:37.946886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:38.006539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:38.014015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-83987f4f-c024-44e4-84df-563c564584a6 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1241 microversion: 2.1 time: 0.080692 Sep 19 10:41:38.014578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 371/756] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:37 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:38.703373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:38.704062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:38.711833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:38.712408 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:38.712947 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:38.713797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:38.714370 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:38.714895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:38.857928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:38.866153 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ca7958e0-9304-41dc-8ba1-d3a15841c3ee tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1515 microversion: 2.1 time: 0.167628 Sep 19 10:41:38.866726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 386/757] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:38 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:38.932114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:38.942096 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:38.942737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:38.943133 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:38.954426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] Creating event network-changed:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:41:38.961644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-1bae64d5-d53a-4a4f-9ae6-2410a1aa2b6e req-b8e07004-5b68-4477-ac48-6350808d4b0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033980 Sep 19 10:41:38.962259 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 372/758] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:39.037647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:39.038248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:39.044065 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:39.044541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:39.044973 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:39.045677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:39.046124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:39.046541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:39.107205 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:39.114759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-999ed59f-7b24-4fa6-862f-2b41b8d2ce67 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1233 microversion: 2.1 time: 0.081490 Sep 19 10:41:39.115317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 387/759] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:39 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1233 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:39.894315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:39.895005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:39.902056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:39.902591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:39.903020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:39.903697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:39.904144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:39.904559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:39.972537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:39.980857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-499b8497-2fb2-4b47-8471-df492edaca51 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1473 microversion: 2.1 time: 0.091294 Sep 19 10:41:39.981487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 373/760] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:39 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:40.137017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:40.137666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:40.146629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:40.147112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:40.147542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:40.148247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:40.148880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:40.149328 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:40.214459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:40.218683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:40.241757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-04b62f00-e5c4-49b1-891a-f44906076b60 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1289 microversion: 2.1 time: 0.091150 Sep 19 10:41:40.241757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 388/761] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:40 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:40.980470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd47b18-24ac-4d6d-b644-7341a99ba737", "name": "network-vif-deleted", "tag": "69027061-065a-436a-9a39-8e161e811331"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:40.991530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.003913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.003913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.006088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:41.006565 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] Creating event network-vif-deleted:69027061-065a-436a-9a39-8e161e811331 for instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 on hv-cinder-85827 Sep 19 10:41:41.007075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:41.012160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-f08e22ee-7250-4264-8466-56221d79ac44 req-186505f1-4e30-4a2d-9088-f6c447ecfc28 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035384 Sep 19 10:41:41.013044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 374/762] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:41.014387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.014961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.015417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.016115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.016595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.017293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.049416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.049923 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.050398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.050876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lazy-loading 'fault' on Instance uuid 4fd47b18-24ac-4d6d-b644-7341a99ba737 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:41.112112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:41.120688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c6203c23-435e-4aeb-955e-9fb159e2604a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 200 len: 1309 microversion: 2.1 time: 0.120483 Sep 19 10:41:41.121353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 389/763] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:40 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:41.248521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:41.249301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:41.255711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.256284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.256807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.257917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:41.259483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:41.259927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:41.421414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:41.432875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-87522da3-9a8e-44a1-ba5d-e87f57eafa87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.188581 Sep 19 10:41:41.433931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 375/764] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:41 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:42.149123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:42.150542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: 4fd47b18-24ac-4d6d-b644-7341a99ba737] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:42.160401 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:42.161612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:42.162787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:42.164213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:42.164848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:42.165605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:42.182294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] HTTP exception thrown: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Request method failure captured: Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 HTTP/1.1 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEcW-uGDr8RlIo9aWw4efTFHbdVJMU6DSm3T1qRdotI9MoyNNtCgdKKXGDC34OASb-czTLU8p6o_LD5gtTJDTlxNHZ09FmI63k14Hh2Xk8cT-WzJ8IAt2XflOuCbXAkftSRAMqIFsYl5r7yO3JIAzcyv7QkVr33N-lG7DQZpODnG728 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: b082859e089143dda3eefee066e4916d Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:41:42.184259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b082859e089143dda3eefee066e4916d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b082859e089143dda3eefee066e4916d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b082859e089143dda3eefee066e4916d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b082859e089143dda3eefee066e4916d"}]}] Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: b082859e089143dda3eefee066e4916d Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesSnapshotTestJSON-2142618770-project Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 884620036bb44462964db97238091c19 Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesSnapshotTestJSON-2142618770-project Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. Sep 19 10:41:42.186052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '4fd47b18-24ac-4d6d-b644-7341a99ba737'} Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:41:42.187239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. Sep 19 10:41:42.188957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:41:42.190706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Returning 404 to user: Instance 4fd47b18-24ac-4d6d-b644-7341a99ba737 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:41:42.190706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-018f4c72-609e-46d7-a817-2298141dbfc1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737" status: 404 len: 111 microversion: 2.1 time: 0.043661 Sep 19 10:41:42.190706 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 390/765] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:42 2022] GET /compute/v2.1/servers/4fd47b18-24ac-4d6d-b644-7341a99ba737 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:41:42.456413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:42.457025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:42.464284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:42.464769 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:42.465383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:42.466079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:42.466538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:42.466954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:42.601932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:42.609896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9e079177-598a-4ff1-b314-de850499e24e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.157960 Sep 19 10:41:42.610471 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 376/766] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:42 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:43.027800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c94dcb-cdf9-4081-828d-7dea73061221", "tag": "227ea2cc-cd70-4dbb-9d73-32648cc95236"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:43.038074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:43.038638 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:43.039118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:43.050101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] Creating event network-changed:227ea2cc-cd70-4dbb-9d73-32648cc95236 for instance 18c94dcb-cdf9-4081-828d-7dea73061221 on hv-cinder-85827 Sep 19 10:41:43.055367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-6a4f566d-96cf-4ccb-a7d4-8ce4166b2d4e req-284d607d-8aca-41d4-8bed-505e234b89be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031476 Sep 19 10:41:43.055928 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 391/767] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:43.184038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:43.184654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:43.191013 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:43.191497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:43.191935 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:43.192658 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:43.193174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:43.193599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:43.218147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2497bd42-ad24-47c2-a2be-0ce87448fcd1 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/ips" status: 200 len: 149 microversion: 2.1 time: 0.145551 Sep 19 10:41:43.218634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 377/768] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:41:43 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/ips => generated 149 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:43.636248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:43.637028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:43.644103 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:43.644634 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:43.645159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:43.646417 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:43.646953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:43.647437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:43.789000 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:43.797169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-423414aa-9bb8-4429-9c56-e22f80aff26a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.166657 Sep 19 10:41:43.797723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 392/769] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:43 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:44.820105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:44.820715 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:44.827003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:44.827485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:44.828096 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:44.828802 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:44.829359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:44.829708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:44.973034 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:44.980811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2c6c52ce-3b5d-46ce-9048-1bf0f09a9dd0 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.164988 Sep 19 10:41:44.981396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 378/770] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:44 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:46.003420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:46.004081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:46.007339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:46.012077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:46.012558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:46.012996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:46.013705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:46.014156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:46.014584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:46.140177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:46.148542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-884672d5-d4c4-4ed8-b6b5-1e9e9650e571 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.148968 Sep 19 10:41:46.149138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 393/771] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:45 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:46.230729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1426833707"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:46.231375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:46.233680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:46.234534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:46.240181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:46.240771 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:46.241343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:46.242161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:46.242726 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:46.243248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:46.374643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.network.security_group_api [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Removing security group 90e1f5cd-0727-4e95-9b17-12a01438d02c from port 679b3a2a-4d03-4c60-b1ac-06853d91645b Sep 19 10:41:46.818608 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a2da64dd-cfc1-40aa-b399-7155c294062b tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action" status: 202 len: 0 microversion: 2.1 time: 0.592696 Sep 19 10:41:46.819107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 379/772] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:41:46 2022] POST /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:41:46.837178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:46.854366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:46.854877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:46.855264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:46.874057 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] Creating event network-changed:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:41:46.880756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-848d46d5-9bfa-4745-8d3e-49334786f978 req-048ccbdb-7a36-4cee-a048-b721e21ce3db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053906 Sep 19 10:41:46.882289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 394/773] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:46.997790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b5d198-19ce-46d1-b16c-7c89322c7ea2"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:47.007014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:47.011723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:47.021468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:47.023305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:47.023740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:47.024555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:47.027186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:47.027763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:47.176191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:47.177003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:47.185572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:47.186082 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:47.186557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:47.187240 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:47.187727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:47.188152 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:47.428969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:47.436890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-01ca75f2-3880-4c8c-8fda-a6e12c204a2c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.268270 Sep 19 10:41:47.437587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 395/774] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:47 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:48.111951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2514ecc5-df1e-4e26-98e4-528b429d7960 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.119212 Sep 19 10:41:48.112813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 380/775] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:41:46 2022] POST /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:48.462951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:48.463533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:48.470883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:48.471377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:48.471867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:48.472649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:48.473224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:48.474491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:48.629385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:48.639161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-18bbe5f6-ab62-4031-8cff-3113074a0ad9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.180573 Sep 19 10:41:48.639998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 396/776] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:48 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:48.659695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:48.660276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:48.667649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:48.668128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:48.668562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:48.669295 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:48.669751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:48.670174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:48.899965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:48.910049 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:48.910534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:48.911031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:48.923963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] Creating event network-changed:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:41:48.929888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-ee6ca144-804b-4375-b58a-ce2e6b36e6a7 req-400e7f29-69a2-422f-9c29-ca9611bbad17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Sep 19 10:41:48.930498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 397/777] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:49.006689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lazy-loading 'services' on Instance uuid 2b450ac7-f6af-4f37-a8fc-199db71c10ac {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:41:49.330020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-88412bda-d207-4f10-929a-228f77e62c4e tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments/265cc58b-b1e2-4e61-9b77-3f146290cc2d" status: 202 len: 0 microversion: 2.1 time: 0.675167 Sep 19 10:41:49.335164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 381/778] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:41:48 2022] DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments/265cc58b-b1e2-4e61-9b77-3f146290cc2d => generated 0 bytes in 681 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:41:49.347105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:49.351041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:49.360478 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:49.362849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:49.362849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:49.363814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:49.364745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:49.365335 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:49.410011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9efff72a-7658-4f1b-ae50-abbb9ef14091 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070583 Sep 19 10:41:49.412101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 398/779] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:49 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:49.665134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:49.665837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:49.672176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:49.672702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:49.673318 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:49.673880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:49.674243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:49.674863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:49.816387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:49.821263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:49.826652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-779fe754-7b0f-47ea-bed0-29d951a3bc03 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.166789 Sep 19 10:41:49.827325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 382/780] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:49 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:50.426123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:50.428274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:50.434609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:50.435088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:50.435518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:50.436231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:50.436680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:50.437123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:50.465490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f40c3fc9-4fda-4d96-a9b7-bf670b048324 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043254 Sep 19 10:41:50.466036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 399/781] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:50 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:50.852620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:50.853316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:50.860808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:50.861376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:50.861861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:50.862618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:50.863120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:50.863590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:50.998710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:51.006765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-73c884a7-386f-4a3c-9248-62b2132519fb tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.158873 Sep 19 10:41:51.007325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 383/782] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:50 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:51.479418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:51.483956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:51.488748 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:51.489265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:51.489747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:51.490420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:51.490866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:51.491351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:51.523704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e139ee15-df38-4d50-bb13-e244d7b2911a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049393 Sep 19 10:41:51.524263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 400/783] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:51 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:52.030206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:52.030812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:52.037736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:52.038216 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:52.038647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:52.039374 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:52.039821 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:52.040224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:52.189548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:52.197886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a08c25b4-eca1-4bbe-a41a-c9eb2c21989d tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.171532 Sep 19 10:41:52.198509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 384/784] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:52 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:52.536791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:52.540033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:52.547726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:52.548232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:52.548659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:52.549406 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:52.549850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:52.550269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:52.586287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-401398bc-41ea-41b3-8abf-f373981c79af tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053460 Sep 19 10:41:52.586965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 401/785] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:52 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:53.188615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-900652075", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "networks": [{"uuid": "baccb219-7bb1-470f-8538-2b1936275ec5"}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:53.222859 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:53.223623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:53.230199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.230825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.231462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.232149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.232650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.233108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.250171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] validate_networks() for [('baccb219-7bb1-470f-8538-2b1936275ec5', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:41:53.378907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:53.388293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-18f5cd9e-0f50-403a-82e7-63ac4ca57595 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.169129 Sep 19 10:41:53.389011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 402/786] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:53 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:53.600371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:53.602575 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:53.609216 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.609733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.610169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.610860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.611306 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.611727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.643410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3657e95e-7fc7-4393-aaec-ceba8093d4c3 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Sep 19 10:41:53.644044 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 403/787] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:53 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:53.683124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:41:53.683540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:41:53.684006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:41:53.684405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:41:53.684811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:41:53.694408 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.694894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.695360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.696087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:53.696539 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:53.696962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:53.713211 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Getting quotas for project b082859e089143dda3eefee066e4916d. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:41:53.717232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Getting quotas for user 884620036bb44462964db97238091c19 and project b082859e089143dda3eefee066e4916d. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:41:53.728578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:41:53.730908 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:41:53.845346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-632d9f78-b48b-4783-97cd-80c6c9460204 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660478 Sep 19 10:41:53.846117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 385/788] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:41:53.858955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0b17e0f7-098e-4f08-9fb4-a30e705677c3 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:53.859615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0b17e0f7-098e-4f08-9fb4-a30e705677c3 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:53.915379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0b17e0f7-098e-4f08-9fb4-a30e705677c3 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:53.922922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0b17e0f7-098e-4f08-9fb4-a30e705677c3 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1218 microversion: 2.1 time: 0.068006 Sep 19 10:41:53.923491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 404/789] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:53 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:54.301143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c94dcb-cdf9-4081-828d-7dea73061221", "name": "network-vif-plugged", "status": "completed", "tag": "227ea2cc-cd70-4dbb-9d73-32648cc95236"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:54.313347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.313922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.314408 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.326260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] Creating event network-vif-plugged:227ea2cc-cd70-4dbb-9d73-32648cc95236 for instance 18c94dcb-cdf9-4081-828d-7dea73061221 on hv-cinder-85827 Sep 19 10:41:54.331905 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-2c05ef97-1776-41dc-a2f7-6dbf9fc0b346 req-4b8a8d63-4f6c-4c4f-a468-89b8b3202051 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034858 Sep 19 10:41:54.334854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 386/790] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:54.418219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:54.419320 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:54.426151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.426747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.427414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.428122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.428570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.432423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.658438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:54.661559 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:54.668986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.672541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.672541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.672541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.672541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.672932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.710233 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ff5269b8-f814-477d-adb2-c7755efec054 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057641 Sep 19 10:41:54.710733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 387/791] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:54 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:41:54.741956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:54.750769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-641bb6a3-8674-4d16-9146-d99f48270d72 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.336624 Sep 19 10:41:54.751431 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 405/792] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:54 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:54.946681 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:54.947938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:54.955432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.955909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.956340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:54.957094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:54.957549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:54.957971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:55.021993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:55.030370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cbe9d856-0062-4144-8938-10e085fd78e9 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1222 microversion: 2.1 time: 0.088034 Sep 19 10:41:55.030971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 388/793] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:54 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:55.723708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:55.726691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:55.733088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:55.733607 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:55.734061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:55.734758 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:55.735213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:55.735635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:55.764081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-368c959b-329f-4c61-ba90-3ccb57d430ae tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 19 10:41:55.764773 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 406/794] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:55 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:55.777614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:55.778214 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:55.784538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:55.785011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:55.785468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:55.786143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:55.787254 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:55.787743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:55.918099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:55.926227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d3703dfc-468f-474f-9240-d9dd747afcdf tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1362 microversion: 2.1 time: 0.152548 Sep 19 10:41:55.926794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 389/795] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:55 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:56.054969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:56.055573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:56.061608 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.062080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.062507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:56.063185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.063635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.064052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:56.125433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:56.133020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c0c8cb7b-dc87-4661-b5a0-2f15e7d7622a tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1270 microversion: 2.1 time: 0.082572 Sep 19 10:41:56.133615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 407/796] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:56 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:56.778257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:56.780809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:56.790839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.790839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.790839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:56.790839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.791276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.791276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:56.823701 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1652022-c047-4677-8dad-50ee79918cec tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049571 Sep 19 10:41:56.828709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 390/797] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:56 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:56.951031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:56.951579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:56.958331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.959444 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.959882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:56.960576 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:56.961031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:56.961483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.101405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:57.106335 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:41:57.111295 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0380ae17-2b8e-4707-a066-32befb549b12 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1549 microversion: 2.1 time: 0.164264 Sep 19 10:41:57.111951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 408/798] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:56 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:57.143516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:57.144094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:57.151668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.152281 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.152822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.153689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.154241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.154753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.155995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:57.156652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:57.164238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.164771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.165293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.166055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.166560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.167033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.233010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:57.243177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8e1d7211-e4e6-47ad-8709-071e48181f8d tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1270 microversion: 2.1 time: 0.091154 Sep 19 10:41:57.246415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 409/799] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:57 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:57.246632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-91f0bdb8-8353-4b5e-9a4f-3c9ec8efcf87 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107779 Sep 19 10:41:57.247118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 391/800] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:41:57 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:57.836349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:57.838589 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:57.844514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.844995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.845479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.846169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:57.846666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:57.847088 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:57.879143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cb1d8153-b873-41dd-8f74-91d323121507 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Sep 19 10:41:57.879686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 410/801] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:57 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:58.266125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:58.266773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:58.273703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:58.274189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:58.274622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:58.275313 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:58.275763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:58.276183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:58.380104 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:58.388357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4c3347e5-7588-41c2-880a-1b6731512ff1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1288 microversion: 2.1 time: 0.126494 Sep 19 10:41:58.391184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 392/802] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:58 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1288 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:41:58.877235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c94dcb-cdf9-4081-828d-7dea73061221", "tag": "227ea2cc-cd70-4dbb-9d73-32648cc95236"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:41:58.888527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:58.889385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:58.890057 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:58.897180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:58.912026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:58.912026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:58.912026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:58.912026 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:58.912382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:58.912458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:58.912939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:58.919662 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] Creating event network-changed:227ea2cc-cd70-4dbb-9d73-32648cc95236 for instance 18c94dcb-cdf9-4081-828d-7dea73061221 on hv-cinder-85827 Sep 19 10:41:58.926721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-091894d7-1a83-4855-a38c-715a8a845e33 req-c56b73a1-7f2c-4ca9-8057-52466a074e35 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141452 Sep 19 10:41:58.928491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 411/803] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:58.960947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0b83cf00-824d-49d6-8727-3f69509bf5fc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073289 Sep 19 10:41:58.962184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 393/804] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:58 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:41:59.415122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:59.415857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:41:59.423027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:59.423534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:59.424162 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:59.425258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:41:59.426081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:41:59.426512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:41:59.631435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:41:59.639430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-da2b3975-6b55-45a7-8681-98ae9817bbf8 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.229372 Sep 19 10:41:59.653209 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 412/805] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:41:59 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:41:59.975938 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:41:59.978182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:00.000365 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.001398 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.001915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.002690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.003207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.003842 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.044046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7d4b1d82-b9de-42f0-81de-889d22749e8d tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073544 Sep 19 10:42:00.045199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 394/806] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:41:59 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:00.095957 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20b5d198-19ce-46d1-b16c-7c89322c7ea2"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:00.098515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:00.104963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.105311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.105752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.106451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.106908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.107338 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.187583 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: POST /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments HTTP/1.1 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 74 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:00.189931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {"volumeAttachment": {"volumeId": "20b5d198-19ce-46d1-b16c-7c89322c7ea2"}} Sep 19 10:42:00.198861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'server_id': '63471bae-c8d3-4b0d-a78a-662fece52413', 'body': {'volumeAttachment': {'volumeId': '20b5d198-19ce-46d1-b16c-7c89322c7ea2'}}} Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:00.200605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:00.204020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 400 to user: Invalid volume: volume 20b5d198-19ce-46d1-b16c-7c89322c7ea2 is already attached to instances: 63471bae-c8d3-4b0d-a78a-662fece52413 {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e4c33ef3-cefb-41f7-856c-619d0cbc6ce2 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099851 Sep 19 10:42:00.205669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 413/807] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:42:00 2022] POST /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:42:00.274521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:00.275018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:00.280918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.281438 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.282924 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.282924 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.283154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.283376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.366572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'services' on Instance uuid 63471bae-c8d3-4b0d-a78a-662fece52413 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:00.603604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ee06bb6a-7cce-47a3-be44-16d78dd3e652 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments/20b5d198-19ce-46d1-b16c-7c89322c7ea2" status: 202 len: 0 microversion: 2.1 time: 0.332669 Sep 19 10:42:00.606662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 395/808] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:42:00 2022] DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments/20b5d198-19ce-46d1-b16c-7c89322c7ea2 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:42:00.613720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:00.616419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:00.623318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.624020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.624728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.625536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.626043 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.626522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.661209 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-50408240-55f5-40f5-b78c-62e0dc62e0d0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051945 Sep 19 10:42:00.661970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 414/809] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:00 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:00.668719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:00.669552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:00.675717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.676418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.676855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.677642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.678091 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.678665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.848105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:00.860574 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-91cfec82-28e0-4b54-ab2e-dd3e03fcd9dd tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.196035 Sep 19 10:42:00.861243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 396/810] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:00 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:00.948254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca57dfc9-7e0d-41cd-be0d-c48e428d0c57", "tag": "4947aaeb-197d-4a50-8259-2cfdc8f42ab7"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:00.957468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:00.957943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:00.958373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:00.969032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] Creating event network-changed:4947aaeb-197d-4a50-8259-2cfdc8f42ab7 for instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 on hv-cinder-85827 Sep 19 10:42:00.973949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-57ed9844-9a8e-4764-afa0-60d25dc89769 req-f6d86b9d-ae96-49f6-8283-1fc315fb6ebb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029369 Sep 19 10:42:00.974538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 415/811] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:01.056656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:01.059013 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:01.065533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.066028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.066453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.067132 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.067578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.068640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.096670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-adfb004c-b113-4af4-ac11-7dbd981442aa tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044731 Sep 19 10:42:01.097290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 397/812] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:01 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:42:01.108939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:01.109554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:01.116136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.116619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.117077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.117776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.118230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.118656 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.199914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] HTTP exception thrown: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac is not attached to volume 265cc58b-b1e2-4e61-9b77-3f146290cc2d Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Request method failure captured: Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments/265cc58b-b1e2-4e61-9b77-3f146290cc2d HTTP/1.1 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEaMSrqxVEuXViQ-vypmZSu_MquDRne5SaSLxsx6HfK-vZxxZF6WlqLjayMedpvJsoQDI_vjjxXs5sUcXCD2KiJuh2Yuiet6ZaDFp7CB2EwBTSV3tqJZhBpxYXJE55EfxQkJhYTrw0e89EW0qf3cmpu6SPpKbGSzG5GhiW_4pKVKNGA Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: c84c95680abc4f28b49cd092ca96fe32 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:01.210304 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c84c95680abc4f28b49cd092ca96fe32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c84c95680abc4f28b49cd092ca96fe32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c84c95680abc4f28b49cd092ca96fe32", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c84c95680abc4f28b49cd092ca96fe32"}]}] Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: c84c95680abc4f28b49cd092ca96fe32 Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-TestMinimumBasicScenario-1095758035-project Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 0b3fcdf3a12147f591c0ea67b57c8c7e Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-TestMinimumBasicScenario-1095758035-project Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:01.211945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac is not attached to volume 265cc58b-b1e2-4e61-9b77-3f146290cc2d Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'server_id': '2b450ac7-f6af-4f37-a8fc-199db71c10ac', 'id': '265cc58b-b1e2-4e61-9b77-3f146290cc2d'} Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 265cc58b-b1e2-4e61-9b77-3f146290cc2d. Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:01.212814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac is not attached to volume 265cc58b-b1e2-4e61-9b77-3f146290cc2d Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac is not attached to volume 265cc58b-b1e2-4e61-9b77-3f146290cc2d Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:01.214229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Returning 404 to user: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac is not attached to volume 265cc58b-b1e2-4e61-9b77-3f146290cc2d {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:01.215505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-971c3374-13c1-49c4-a872-ab8ead364021 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments/265cc58b-b1e2-4e61-9b77-3f146290cc2d" status: 404 len: 154 microversion: 2.1 time: 0.107637 Sep 19 10:42:01.215505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 416/813] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:42:01 2022] DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac/os-volume_attachments/265cc58b-b1e2-4e61-9b77-3f146290cc2d => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:01.674587 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:01.676880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:01.683019 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.686569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.686569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.686569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.686569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.686962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.715134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4e0f48bb-48ab-4367-a36d-b892d0eae8e9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Sep 19 10:42:01.715680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 398/814] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:01 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:01.884436 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:01.885169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:01.891644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.892172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.892657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:01.893794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:01.894263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:01.894736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:02.033961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:02.042410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cd77c5c8-62ca-44e0-a1e9-aa5ba0245065 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.162403 Sep 19 10:42:02.043024 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 417/815] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:01 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:02.563886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:02.564472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:02.572708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:02.573360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:02.573913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:02.574755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:02.575304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:02.575814 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:02.605936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:02.638913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:02.728180 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:02.730492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:02.737364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:02.737849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:02.738284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:02.738974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:02.739429 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:02.740422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:02.771381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-250ce682-483a-4cdd-a195-152090c5397d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Sep 19 10:42:02.772283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 418/816] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:02 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:02.993629 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-392b63a4-0019-446c-8574-76282459a617 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 204 len: 0 microversion: 2.1 time: 0.434081 Sep 19 10:42:02.994311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 399/817] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:02 2022] DELETE /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:42:03.003392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:03.004052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:03.010686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.011215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.011709 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.012587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.013127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.013603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.068126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:03.068884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:03.075824 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.076361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.076906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.077702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.078202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.078697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.157028 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:03.165945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-98ea01f9-ccf0-4915-95e2-47a4c4c3c290 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1554 microversion: 2.1 time: 0.167130 Sep 19 10:42:03.166578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 419/818] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:02 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:03.221637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:03.230488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bb1dcd0a-9f2c-4e19-86f7-d0ffaf1ab31b tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.167030 Sep 19 10:42:03.231155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 400/819] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:03 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:03.784129 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:03.786308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:03.793485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.793961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.795275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.795275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.795602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.796045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.827818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2eb3ed88-9edf-47c7-ac04-839ce07620b9 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047828 Sep 19 10:42:03.829751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 420/820] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:03 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:42:03.905446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:03.905976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:03.908370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:03.909117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:03.914888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.915371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.915833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.916616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:03.917086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:03.917510 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:03.942962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:04.188278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:04.188892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:04.191023 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:04.196114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.201653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.201653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.201653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.201653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.202287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.262325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-288892ac-3795-453a-a0a1-caf1b3738c68 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 204 len: 0 microversion: 2.1 time: 0.360616 Sep 19 10:42:04.263143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 401/821] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:03 2022] DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:42:04.269125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:04.269900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:04.276570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.277068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.277537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.278236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.278689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.279112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.342109 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:04.350731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-654eb133-fcbe-4b74-b906-8cda3db6c7e4 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1554 microversion: 2.1 time: 0.166437 Sep 19 10:42:04.351271 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 421/822] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:04 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:04.365914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:04.365914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:04.365914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.365914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.370454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.370454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:04.370454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:04.370454 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:04.438094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:04.447119 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-176d1ba5-eb97-4ad7-8cd9-cadffe92f757 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.182651 Sep 19 10:42:04.447895 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 402/823] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:04 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:04.508995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:04.520111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-99796742-1613-4d7d-bc66-631d70c10fa0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1680 microversion: 2.1 time: 0.167710 Sep 19 10:42:04.520960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 422/824] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:04 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:05.376392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:05.376911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:05.384005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.384485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.384918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.385634 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.386086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.386515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.469151 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:05.469772 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:05.472066 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=94 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:05.477019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.477522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.477984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.478677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.479128 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.479549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.515734 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:05.523976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6c12248e-67c6-4480-9b76-4757b8bafbc0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1554 microversion: 2.1 time: 0.151484 Sep 19 10:42:05.524826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 403/825] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:05 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:05.544593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:05.545382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:05.552787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.553723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.553885 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.554675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:05.555219 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:05.555768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:05.616902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:05.624652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b6881f0f-d094-4a4d-a1f9-9cca8241fe79 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.159327 Sep 19 10:42:05.625248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 423/826] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:05 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:05.698090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:05.705877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0ddd621e-0a60-4522-bbb2-7932d14c37bd tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1680 microversion: 2.1 time: 0.165838 Sep 19 10:42:05.706444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 404/827] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:05 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:06.222847 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:06.223377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:06.230027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.230543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.230996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.231677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.232123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.232543 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.257171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6cfe708a-a857-4570-85f4-8ecc46448bd0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/ips" status: 200 len: 153 microversion: 2.20 time: 0.096899 Sep 19 10:42:06.257774 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 424/828] 10.222.0.42 () {60 vars in 1289 bytes} [Mon Sep 19 10:42:06 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/ips => generated 153 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:42:06.478360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57dfc9-7e0d-41cd-be0d-c48e428d0c57", "name": "network-vif-plugged", "status": "completed", "tag": "4947aaeb-197d-4a50-8259-2cfdc8f42ab7"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:06.488886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.489389 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.490740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.500798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] Creating event network-vif-plugged:4947aaeb-197d-4a50-8259-2cfdc8f42ab7 for instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 on hv-cinder-85827 Sep 19 10:42:06.507542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-5aa5330d-f271-435e-a4c4-02b00abe2098 req-4de2eedf-5530-4b52-82db-16ac5ff084e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Sep 19 10:42:06.508225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 405/829] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:06.547887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:06.548651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:06.556321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.556892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.557460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.558292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.558842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.559367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.649872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:06.650745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:06.663862 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.664722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.665633 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.666660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.667237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.667924 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.721488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:06.731644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-336a47e2-b419-4d29-bf45-cbf35b01f3ca tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1554 microversion: 2.1 time: 0.188229 Sep 19 10:42:06.732343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 425/830] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:06 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:06.737912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:06.738905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:06.746075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.746654 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.747394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.748266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:06.748807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:06.749399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:06.814503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:06.822850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5fefc4cf-e6c4-479a-8aca-7034029409a7 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.178623 Sep 19 10:42:06.823415 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 406/831] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:06 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:06.889110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:06.897887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e9f6cf99-49a8-4556-ab7d-e7d6f0fc1912 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1680 microversion: 2.1 time: 0.164440 Sep 19 10:42:06.898522 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 426/832] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:06 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:07.684569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b450ac7-f6af-4f37-a8fc-199db71c10ac", "name": "network-vif-deleted", "tag": "679b3a2a-4d03-4c60-b1ac-06853d91645b"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:07.694276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.695109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.695203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.706743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] Creating event network-vif-deleted:679b3a2a-4d03-4c60-b1ac-06853d91645b for instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac on hv-cinder-85827 Sep 19 10:42:07.712346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-8556bf34-e692-4eb0-8bcc-f28c2bebee6d req-faa32951-d257-4f9e-b264-c7b9c16caf57 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088046 Sep 19 10:42:07.715824 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 407/833] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:07.754721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:07.755388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:07.761989 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.762474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.762909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.763598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.764052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.764476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.768730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=100 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:07.828630 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:07.837184 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-669853ae-f3fd-4872-b128-376445202ae8 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1512 microversion: 2.1 time: 0.086269 Sep 19 10:42:07.837703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 427/834] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:07 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:07.847782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:07.849555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:07.855641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.856141 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.856579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.857299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.857752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.858174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.926505 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:07.927787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:07.935776 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.936763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.938064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:07.938913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:07.939643 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:07.940192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.023572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:08.041822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b9ce6fcf-2606-454b-b20a-5431fe2dc79a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1612 microversion: 2.1 time: 0.120972 Sep 19 10:42:08.044771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 428/835] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:07 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1612 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:08.130827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:08.139048 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-17bcb7fc-3bb8-44db-9578-69452a187d31 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.295806 Sep 19 10:42:08.143414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 408/836] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:07 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:08.614283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63471bae-c8d3-4b0d-a78a-662fece52413", "name": "network-vif-deleted", "tag": "c7008b17-5a50-4d85-96c4-a43efa4cf1f5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:08.627915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.628728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.629452 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.646787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] Creating event network-vif-deleted:c7008b17-5a50-4d85-96c4-a43efa4cf1f5 for instance 63471bae-c8d3-4b0d-a78a-662fece52413 on hv-cinder-85827 Sep 19 10:42:08.652242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-86bab39f-a279-4c7b-851d-6647db799df9 req-5e3811dc-9def-4de7-9ff8-724c9df9869f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042218 Sep 19 10:42:08.652892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 429/837] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:08.861109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:08.861754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:08.868310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.868789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.869267 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.869952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.870396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.870871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.903757 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.904236 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.904664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.905126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lazy-loading 'fault' on Instance uuid 2b450ac7-f6af-4f37-a8fc-199db71c10ac {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:08.951624 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:08.952272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:08.954599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:08.959678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.960495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.960979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.961703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:08.962194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:08.962620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:08.963572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-263a9807-462a-4295-8820-36a845db36e0 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1348 microversion: 2.1 time: 0.106399 Sep 19 10:42:08.964200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 409/838] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:08 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:09.002590 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'flavor' on Instance uuid c0e10a45-f231-4231-a5de-a46e49d7ccf2 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:09.072906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:09.073660 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:09.084387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.084387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.084387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.084387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.085030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.085030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.156937 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:09.169717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a2cbe90f-db74-4bcd-8af1-19aab6b11200 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1612 microversion: 2.1 time: 0.101327 Sep 19 10:42:09.170564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 410/839] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:09 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:09.176032 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:09.176810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:09.183984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.184693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.185304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.186210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.186830 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.187358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.336563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:09.357900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8ab52fb0-4fa0-45c9-8b98-13000d49f1c1 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1318 microversion: 2.1 time: 0.185930 Sep 19 10:42:09.372160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 411/840] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:09 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:09.684790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3b4d023b-7d01-4f48-a3e0-17e739b0d33e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/action" status: 202 len: 0 microversion: 2.20 time: 0.737334 Sep 19 10:42:09.685442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 430/841] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 19 10:42:08 2022] POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:42:09.693911 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:09.694834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:09.701342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.701834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.702272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.702966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.703420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.703844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.842867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:09.851486 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:09.852966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:09.854287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bd9ec045-cee9-4eae-a388-771b18af8824 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.164410 Sep 19 10:42:09.854860 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 412/842] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:09 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:09.988400 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:09.989113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:09.996796 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.997364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.998005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:09.999241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:09.999379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:09.999806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.032813 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.033368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.033856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.034349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lazy-loading 'fault' on Instance uuid 2b450ac7-f6af-4f37-a8fc-199db71c10ac {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:10.080816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b3fcdf3a12147f591c0ea67b57c8c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84c95680abc4f28b49cd092ca96fe32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:10.089359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f4f02f2c-7c30-49df-9869-404a8d12955a tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 200 len: 1348 microversion: 2.1 time: 0.105730 Sep 19 10:42:10.090007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 431/843] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:09 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:10.193471 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:10.194117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:10.200703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.201252 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.201686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.202383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.202852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.203304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.237426 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.237903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.238359 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.238798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'fault' on Instance uuid 63471bae-c8d3-4b0d-a78a-662fece52413 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:10.282264 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:10.290573 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e109ea90-0e71-4627-afb9-58c4d5b245a8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 200 len: 1330 microversion: 2.1 time: 0.101121 Sep 19 10:42:10.291490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 413/844] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:10 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:10.383219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:10.384002 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:10.390212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.390692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.391127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.391864 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.392327 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.392775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.543947 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:10.551686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c05ab7f5-25ff-4c56-8ced-716fe1e9203c tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1507 microversion: 2.1 time: 0.172945 Sep 19 10:42:10.552282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 432/845] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:10 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:10.574787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24f8d777-0b75-41d5-83f2-91ac7f76f18f", "device": "/dev/sdb"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:10.577524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:10.584612 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.585169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.585661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.586430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.586940 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.587417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.605245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:10.880114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:10.880661 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:10.886803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.887279 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.887759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:10.888393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:10.888834 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:10.889298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:11.018493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:11.028660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:11.035621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:11.035621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-befd8913-ed38-4b6c-9414-8298547eecf1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.155673 Sep 19 10:42:11.035621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 433/846] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:10 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:11.112142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:11.112803 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] [instance: 2b450ac7-f6af-4f37-a8fc-199db71c10ac] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:11.120195 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:11.120733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:11.121247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:11.122054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:11.122703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:11.123439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:11.138186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] HTTP exception thrown: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Request method failure captured: Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac HTTP/1.1 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEaMSrqxVEuXViQ-vypmZSu_MquDRne5SaSLxsx6HfK-vZxxZF6WlqLjayMedpvJsoQDI_vjjxXs5sUcXCD2KiJuh2Yuiet6ZaDFp7CB2EwBTSV3tqJZhBpxYXJE55EfxQkJhYTrw0e89EW0qf3cmpu6SPpKbGSzG5GhiW_4pKVKNGA Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: c84c95680abc4f28b49cd092ca96fe32 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:11.139873 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c84c95680abc4f28b49cd092ca96fe32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c84c95680abc4f28b49cd092ca96fe32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c84c95680abc4f28b49cd092ca96fe32", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c84c95680abc4f28b49cd092ca96fe32"}]}] Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: c84c95680abc4f28b49cd092ca96fe32 Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1095758035 Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-TestMinimumBasicScenario-1095758035-project Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 0b3fcdf3a12147f591c0ea67b57c8c7e Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-TestMinimumBasicScenario-1095758035-project Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. Sep 19 10:42:11.141729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '2b450ac7-f6af-4f37-a8fc-199db71c10ac'} Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:11.142816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. Sep 19 10:42:11.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.146198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Returning 404 to user: Instance 2b450ac7-f6af-4f37-a8fc-199db71c10ac could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:11.146198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-03459ce1-5a47-455d-b6a6-0ed989f6d9e7 tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac" status: 404 len: 111 microversion: 2.1 time: 0.033262 Sep 19 10:42:11.146198 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 434/847] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:11 2022] GET /compute/v2.1/servers/2b450ac7-f6af-4f37-a8fc-199db71c10ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:42:11.150420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-101d3461-161d-4bc3-ad53-efa8b04179cc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] Calling method '.version_select at 0x7fb943064550>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:11.223494 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-101d3461-161d-4bc3-ad53-efa8b04179cc tempest-TestMinimumBasicScenario-1095758035 tempest-TestMinimumBasicScenario-1095758035-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485628078" status: 202 len: 0 microversion: 2.1 time: 0.076603 Sep 19 10:42:11.224700 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 435/848] 10.222.0.42 () {58 vars in 1272 bytes} [Mon Sep 19 10:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1485628078 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:42:11.316875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:11.317504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:11.324310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:11.324791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:11.325254 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:11.326062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:11.326513 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:11.326935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:11.340689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 HTTP/1.1 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:11.342283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:42:11.343831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '63471bae-c8d3-4b0d-a78a-662fece52413'} Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:11.348125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:42:11.350615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:11.351919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:11.351919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f0b0f48e-477e-4a1d-926a-22d1a2ab0baa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 404 len: 111 microversion: 2.1 time: 0.030797 Sep 19 10:42:11.351919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 436/849] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:11 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:11.352991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-07e5fd73-5956-4f95-a670-a2340979c13d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '.version_select at 0x7fb9431909d0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:11.437042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8bdf44fd-b2a5-4860-b4fd-ccc570802fb5 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "POST /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866307 Sep 19 10:42:11.437768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 414/850] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:42:10 2022] POST /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:11.451820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-07e5fd73-5956-4f95-a670-a2340979c13d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143317783" status: 202 len: 0 microversion: 2.1 time: 0.103080 Sep 19 10:42:11.452398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 437/851] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 19 10:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143317783 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:42:12.060373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:12.061083 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:12.063058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:12.068661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:12.069168 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:12.069606 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:12.070305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:12.070760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:12.071183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:12.211749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:12.220813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:12.222451 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:12.223815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-afb7477e-24c7-4e77-8cbf-c87a42e3fa85 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.168388 Sep 19 10:42:12.225018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 415/852] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:12 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:12.345358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-09d2a166-5abe-4704-b043-07558a3b9f00 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: .version_select at 0x7fb943216550>, body: {"keypair": {"name": "tempest-keypair-780064073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNH+P8UKZV2oYfClyXb9IVfvn77fa4hWX1CNQ93UZ0VGI7tUNatyznQGx4MoIVQd6nieVv2KLbRIMUUlgUQ/i5Y/or5e2dQ4fMDN+VYSgSWh1GcQk7j3xxelfH0pMPr+lQ=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:12.361960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-09d2a166-5abe-4704-b043-07558a3b9f00 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:42:12.366068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-09d2a166-5abe-4704-b043-07558a3b9f00 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:42:12.496698 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-09d2a166-5abe-4704-b043-07558a3b9f00 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155669 Sep 19 10:42:12.497484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 438/853] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:42:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:13.252891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:13.253577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:13.260785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:13.266245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:13.266245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:13.266245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:13.266245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:13.266649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:13.536958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:13.560241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:13.562223 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:13.563667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ed3a4a8d-67b2-4a80-b95a-57f28a4670fc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.315459 Sep 19 10:42:13.564335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 416/854] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:13 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:14.602573 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:14.604856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:14.648483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:14.649294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:14.650603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:14.652158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:14.657269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:14.657269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:14.914125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:14.929460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:14.931171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:14.932882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3f8564a0-a9ba-4187-91c0-5643cdfdc48e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.340728 Sep 19 10:42:14.935399 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 439/855] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:14 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:14.998414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-563857175", "imageRef": "1a989d5d-bd10-422d-964c-f951a92aec45", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c"}], "security_groups": [{"name": "tempest-securitygroup--956792427"}], "key_name": "tempest-keypair-780064073", "user_data": "}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:15.166805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] validate_networks() for [('9fbc7bd5-1f07-4dfa-a5f3-320af441bb3c', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:42:15.746528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:42:15.747156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:42:15.747787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:42:15.748387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:42:15.748954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:42:15.759145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:15.760065 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:15.760656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:15.761833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:15.762601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:15.768607 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:15.785542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:42:15.790564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Getting quotas for user 8a059ba74d744a12a4694513f8ca5789 and project e86736f46b254bc399298305a8888467. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:42:15.807686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:42:15.810590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1a989d5d-bd10-422d-964c-f951a92aec45',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:42:15.922493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f96b9f79-16e2-4289-a69f-71bb58b25305 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.928395 Sep 19 10:42:15.923141 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 417/856] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:42:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 10:42:15.935423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-84f54dd3-0b4c-454a-b03e-7ffd1c55732a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:15.936031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-84f54dd3-0b4c-454a-b03e-7ffd1c55732a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:15.965050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:15.966056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:15.975395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:15.976086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:15.977159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:15.978361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:15.978974 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:15.979549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:16.000487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-84f54dd3-0b4c-454a-b03e-7ffd1c55732a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:16.008749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-84f54dd3-0b4c-454a-b03e-7ffd1c55732a tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1240 microversion: 2.1 time: 0.077143 Sep 19 10:42:16.009903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 440/857] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:15 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:16.223074 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:16.231827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:16.233291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:16.234452 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-54dbcfb3-7332-4164-83de-98f1a5122143 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.273399 Sep 19 10:42:16.235015 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 418/858] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:15 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:17.035246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-83de2b3f-ea2d-4988-809d-2e46000a61dc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:17.035795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-83de2b3f-ea2d-4988-809d-2e46000a61dc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:17.099749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-83de2b3f-ea2d-4988-809d-2e46000a61dc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:17.107489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-83de2b3f-ea2d-4988-809d-2e46000a61dc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1240 microversion: 2.1 time: 0.076546 Sep 19 10:42:17.108069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 441/859] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:17 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:17.267735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:17.267735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:17.273796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:17.274307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:17.274721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:17.276131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:17.276592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:17.277092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:17.458599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:17.468031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:17.469488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:17.470664 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-548447da-3fd3-49cd-8ed5-e6e6f19e2a6a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.210251 Sep 19 10:42:17.471225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 419/860] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:17 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:17.990994 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:17.991495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:17.997689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:17.997987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:17.998442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:17.999193 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:17.999647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.000069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.092836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'services' on Instance uuid 041b4a5e-774b-4a16-8082-d884ff033f63 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:18.136797 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:18.137644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:18.145166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.145829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.146378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.147397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.147763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.148378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.256123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:18.264709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a37d146b-4472-47e0-b720-2d2d68652412 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1292 microversion: 2.1 time: 0.136444 Sep 19 10:42:18.276542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 420/861] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:18 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1292 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:18.416565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-68e88066-3b20-472b-9ee7-cb30f541c0e7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments/ed944c6b-599d-45e1-9a7b-25c437727214" status: 202 len: 0 microversion: 2.1 time: 0.429579 Sep 19 10:42:18.417260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 442/862] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:42:17 2022] DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments/ed944c6b-599d-45e1-9a7b-25c437727214 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:42:18.425509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:18.428239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:18.434720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.435201 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.435635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.436315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.436768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.437224 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.468957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-36c86e14-80ae-4f38-884c-b314ed242bbe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047276 Sep 19 10:42:18.469760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 421/863] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:18 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:18.499426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:18.513731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:18.513731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.513731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.513731 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.514613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:18.514613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:18.514613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:18.663999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:18.673333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:18.674771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:18.676524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-be8d14de-4e50-431e-b50a-e50a9b43488e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.182779 Sep 19 10:42:18.677266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 443/864] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:18 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:19.288360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:19.289005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:19.295424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.295932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.296370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.297089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.297550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.298030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.374095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:19.383422 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a42cfadc-0187-463d-9de5-81ee4bac5bd0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1292 microversion: 2.1 time: 0.099121 Sep 19 10:42:19.398339 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 422/865] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:19 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1292 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:19.483098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:19.485897 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:19.493593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.494215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.494744 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.495571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.496170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.496707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.542053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-80a7dc98-a893-48a2-b3bd-c0dbaa5721ec tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060956 Sep 19 10:42:19.542053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 444/866] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:19 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:19.702407 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:19.708948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:19.710963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.711442 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.711875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.712563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:19.713005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:19.713452 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:19.879418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:19.892569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:19.892569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:19.892569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-001daa20-0da5-4c3c-8ee5-8723fc9e634f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.194004 Sep 19 10:42:19.893770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 423/867] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:19 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:20.411939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:20.413297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:20.423414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.441191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.441191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.441191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.441191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.441575 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.559179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:20.562532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:20.578625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.578625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.578625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.579675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.581618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.584522 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.588770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:20.606710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2ffdb806-d8d1-44aa-a829-4d5868108cd3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1310 microversion: 2.1 time: 0.196363 Sep 19 10:42:20.606710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 445/868] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:20 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1310 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:20.654912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d6f09e1a-61b5-4433-9c03-9170bc416007 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105417 Sep 19 10:42:20.655590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 424/869] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:42:20 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 19 10:42:20.756711 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:20.757301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:20.763838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.764373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.764870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.765667 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.766174 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.766650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.794351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:20.842119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:20.927804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:20.928526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:20.938059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.938696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.939386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:20.940460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:20.941276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:20.941875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:21.188148 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-eaa343b5-6fd7-430e-80d5-735e20b6b127 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 204 len: 0 microversion: 2.1 time: 0.435334 Sep 19 10:42:21.188981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 446/870] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:20 2022] DELETE /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:42:21.199062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:21.200473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:21.207298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:21.207736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:21.208801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:21.209717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:21.210172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:21.210635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:21.277308 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:21.290129 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:21.292394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:21.296808 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-303708a8-f888-4d26-9e07-364daa2d36c2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.376468 Sep 19 10:42:21.300540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 425/871] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:20 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:21.484129 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:21.499488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7def700b-01c2-405e-9127-94193ee1871c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.305621 Sep 19 10:42:21.506626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 447/872] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:21 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:21.629637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:21.631028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:21.637525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:21.638229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:21.638905 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:21.639848 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:21.640505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:21.641636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:21.836340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:21.844209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-633d4b18-e73f-40f8-9f21-32ef8bd7e207 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.218414 Sep 19 10:42:21.844779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 426/873] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:21 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:22.324369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:22.324972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:22.331499 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.333984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.333984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:22.333984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.334507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.334675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:22.475188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:22.483953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:22.485492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:22.486646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c6360521-236d-416c-9953-5dfca3a5d2e1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.166365 Sep 19 10:42:22.487228 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 448/874] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:22 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:22.529963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:22.530569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:22.537613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.538148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.538635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:22.539419 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.539923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.540405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:22.683801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:22.692583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fbf72507-934a-4541-bc7d-70dbce744665 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.166674 Sep 19 10:42:22.693772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 427/875] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:22 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:22.870816 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:22.871441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:22.878693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.879309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.879760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:22.881140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:22.881140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:22.881905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:23.034525 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:23.042727 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6f589e97-9364-46db-9e54-54b7c3c0f2cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.176135 Sep 19 10:42:23.043311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 449/876] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:22 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:23.513677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:23.514435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:23.522638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:23.523249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:23.523793 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:23.524632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:23.525208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:23.525720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:23.685377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:23.694097 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:23.695603 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:23.696778 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c96ef8a8-0247-4134-af02-d11538cece79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.187880 Sep 19 10:42:23.697371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 428/877] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:23 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:23.718759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:23.719365 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:23.726429 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:23.726932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:23.727354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:23.728196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:23.729691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:23.729691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:23.865371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:23.873353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-88dde252-0bfe-4f07-afeb-a364b23aefdd tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.158930 Sep 19 10:42:23.878023 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 450/878] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:23 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:24.065146 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:24.065754 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:24.071962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.072445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.072881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.073606 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.074060 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.074494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.215268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:24.222855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e4d1849a-850d-4c89-a3c8-75b949f27a5b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.161518 Sep 19 10:42:24.223420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 429/879] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:24 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:24.726632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:24.727234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:24.733879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.734379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.734846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.735546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.735992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.736412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.868597 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:24.876281 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:24.877763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:24.878934 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-91373412-c506-47fe-a28f-ca95f6dbb09b tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.156524 Sep 19 10:42:24.879489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 451/880] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:24 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:24.897859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:24.898460 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:24.904836 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.905427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.905916 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.906593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:24.907042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:24.907458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:24.925051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:25.041500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:25.050036 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-aa04044a-eaa4-4a31-853d-6bdb2281ebfe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.156155 Sep 19 10:42:25.050777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 430/881] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:24 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:25.246039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:25.246642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:25.252896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:25.253465 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:25.253913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:25.254607 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:25.255557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:25.255982 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:25.389309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:25.398130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2dcbae8e-0092-4b17-bc0e-329d1ff8f8d3 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.155847 Sep 19 10:42:25.398689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 452/882] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:25 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:25.904665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:25.905217 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:25.907380 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:25.908067 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:25.913599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:25.914079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:25.914511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:25.915199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:25.915651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:25.916075 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:26.057614 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:26.065610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:26.067044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:26.068258 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d04e89c2-58bd-484f-bc29-79eee32967c5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.167578 Sep 19 10:42:26.068813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 431/883] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:25 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:26.079922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:26.089822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:26.089822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:26.089822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:26.089822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:26.090269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:26.090269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:26.090269 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:26.246567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:26.255524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8db53391-e23d-4746-bc56-c382551f5cd6 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.179359 Sep 19 10:42:26.256114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 453/884] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:26 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:26.420792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:26.421417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:26.427410 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:26.427821 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:26.428251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:26.428929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:26.429396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:26.429813 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:26.568556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:26.576171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-493867ae-c05f-4a21-a076-32f5ebe131cb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.159192 Sep 19 10:42:26.576733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 432/885] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:26 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:27.093949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:27.094649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:27.101899 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.102414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.102909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.105125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.105125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.105125 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.109110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=8 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:27.245164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:27.254113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:27.255760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:27.257170 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bc8d28a1-fb8f-4f5c-be37-90369be10cfe tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.167506 Sep 19 10:42:27.258127 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 454/886] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:27 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:27.280206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:27.281017 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:27.288475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.288951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.289569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.290474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.291025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.291555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.430840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:27.438434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-67328e5e-efbd-481b-b34a-a4fce13c268b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.162447 Sep 19 10:42:27.439000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 433/887] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:27 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:27.600379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:27.601122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:27.607660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.608138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.608572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.609302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:27.609753 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:27.610173 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:27.739858 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:27.748524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-393e4ca6-80af-45a0-bf74-167bdd1e1f69 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.152279 Sep 19 10:42:27.749380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 455/888] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:27 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:28.284532 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:28.285179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:28.291760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.292172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.292603 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.293315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.293764 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.294186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.423502 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:28.433030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:28.434819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:28.436213 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ad5daf0b-d0b0-4705-99c7-f79cb663bf86 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.155476 Sep 19 10:42:28.436919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 434/889] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:28 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:28.461843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:28.462448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:28.471666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.472168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.472610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.473653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.473911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.474231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.645533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:28.654870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bfefb783-97ba-4e11-92d5-931fc4471b97 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.197993 Sep 19 10:42:28.655498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 456/890] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:28 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:28.775056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:28.775780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:28.785008 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.785804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.786892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.787661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:28.788173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:28.788643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:28.948999 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:28.958600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6bf570cc-0924-4aa6-953a-3e398b3f02db tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.187763 Sep 19 10:42:28.973149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 435/891] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:28 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:29.467401 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:29.468083 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:29.475681 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.476217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.477053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.478029 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.478689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.479310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.606241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ba0f71-e73d-4922-b06f-8ccb43695e4f", "tag": "5403da25-9f83-4b67-bacf-db0017b912d5"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:29.622542 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.636918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.638234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.658161 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] Creating event network-changed:5403da25-9f83-4b67-bacf-db0017b912d5 for instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f on hv-cinder-85827 Sep 19 10:42:29.668256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-5e48ce8b-048a-4e40-91b8-0775566ab699 req-0300479e-52fd-4b9f-9fba-dd22319cd71e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069679 Sep 19 10:42:29.670696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 436/892] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:29.687063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:29.688582 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:29.694822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.696243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.696243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.696683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.697253 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.697752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.755547 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:29.767048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:29.769804 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:29.771688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a2434e62-b329-4be8-a876-584598194e34 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.308518 Sep 19 10:42:29.773418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 457/893] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:29 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:29.932879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:29.942353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c5527f1e-b09c-4c1a-a1d2-28b3dc035b6d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1689 microversion: 2.1 time: 0.265358 Sep 19 10:42:29.943043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 437/894] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:29 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1689 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:29.983105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:29.983758 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:29.990521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.991021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.991616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:29.992414 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:29.992884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:29.993332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:30.131702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:30.139652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-837c0aaa-d17c-4da1-abe2-f63beade73eb tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.160949 Sep 19 10:42:30.140289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 458/895] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:29 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:30.502238 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041b4a5e-774b-4a16-8082-d884ff033f63", "name": "network-vif-deleted", "tag": "e1416496-e4ee-4d30-b099-b5b41ef7198f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:30.512785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:30.513386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:30.514114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:30.528936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] Creating event network-vif-deleted:e1416496-e4ee-4d30-b099-b5b41ef7198f for instance 041b4a5e-774b-4a16-8082-d884ff033f63 on hv-cinder-85827 Sep 19 10:42:30.534562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-f0ff5adc-416a-44d0-b666-4bfc18d70c15 req-183d4cdb-d219-41fd-9f17-ddd7dcce3056 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036168 Sep 19 10:42:30.535385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 438/896] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:30.805470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:30.809913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:30.828191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:30.828683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:30.831480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:30.832428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:30.832890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:30.833636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:30.975725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:30.980169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:30.986057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:30.986787 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:30.987414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:30.988329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:30.988929 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:30.990246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:31.026753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:31.027509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:31.028094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:31.028694 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid 041b4a5e-774b-4a16-8082-d884ff033f63 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:31.074512 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:31.084307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4304c508-8cae-4480-937f-771efcfa534f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1336 microversion: 2.1 time: 0.117340 Sep 19 10:42:31.085679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 439/897] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:30 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:31.090235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:31.099954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:31.101673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:31.103068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-83f0c923-c7bf-444a-ad93-19897fb65415 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1746 microversion: 2.20 time: 0.307377 Sep 19 10:42:31.109172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 459/898] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:30 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1746 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:31.164367 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:31.165093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:31.171050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:31.171662 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:31.172099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:31.172784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:31.173262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:31.173728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:31.312756 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:31.322437 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d197266e-1b1c-4d01-b724-53b9f18aa01e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.162432 Sep 19 10:42:31.323442 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 440/899] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:31 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:32.108702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:32.109292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:32.111626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:32.117695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.118179 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.118615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.119292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.119739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.120159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.130702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:32.131419 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:32.139004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.139620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.140157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.141005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.141579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.142081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.154401 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.154884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.155321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.155769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid 041b4a5e-774b-4a16-8082-d884ff033f63 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:32.202119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:32.212076 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c82653b1-c61b-4de8-ad6c-da8ccbe0bd3f tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1336 microversion: 2.1 time: 0.107526 Sep 19 10:42:32.212758 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 460/900] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:32 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:32.280906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:32.291357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:32.293113 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:32.296897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-272f5142-c0da-460d-a9d4-55400c698c2c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1746 microversion: 2.20 time: 0.169188 Sep 19 10:42:32.296897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 441/901] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:32 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:32.348116 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:32.349483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:32.356831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.357420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.357945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.358811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:32.359292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:32.359798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:32.491892 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:32.499540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-312d5cff-dd01-4bc4-85ca-c781f6f0622b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.156250 Sep 19 10:42:32.500101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 461/902] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:32 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:33.074117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:33.074611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:33.080546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.081029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.081501 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.082196 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.082649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.083103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.173698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lazy-loading 'services' on Instance uuid ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:33.237982 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:33.238612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:33.245460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.248274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.248274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.248274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.248274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.248685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.266455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:33.280532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.281094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.281532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.281975 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid 041b4a5e-774b-4a16-8082-d884ff033f63 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:33.322567 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:33.330267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f8c2cfca-9ba1-4d90-8a31-6ab391a2486d tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 200 len: 1336 microversion: 2.1 time: 0.096194 Sep 19 10:42:33.339021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 462/903] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:33 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:33.339021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:33.339021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:33.343840 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.344340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.344787 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.345688 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.346067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.346490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.490527 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:33.493831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a8ec3cfa-6c93-4ec4-9341-6378c7c1b047 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57/os-volume_attachments/24f8d777-0b75-41d5-83f2-91ac7f76f18f" status: 202 len: 0 microversion: 2.1 time: 0.423398 Sep 19 10:42:33.494517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 442/904] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:42:33 2022] DELETE /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57/os-volume_attachments/24f8d777-0b75-41d5-83f2-91ac7f76f18f => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:42:33.503418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:33.505982 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:33.508036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-443e5e7e-ad0a-4fbc-b8a3-51f79b9e7124 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1746 microversion: 2.20 time: 0.176275 Sep 19 10:42:33.508638 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 463/905] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:33 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1746 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:33.525368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:33.527179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:33.533941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.534590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.535035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.535740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:33.536275 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:33.536743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:33.691446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:33.700127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-dc1d2b37-a775-407e-8fc1-fe17b28d995b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.181319 Sep 19 10:42:33.700816 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 443/906] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:33 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:34.355258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:34.355893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 041b4a5e-774b-4a16-8082-d884ff033f63] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:34.362947 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.369420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.369420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.369420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.369420 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.369896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.379844 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] HTTP exception thrown: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Request method failure captured: Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 HTTP/1.1 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEaAEpWevJa7FpLX7Feyysk1znYHiXN_UdOa63ocETlcpKwqN8cTVL0dgsXQO8sjKztfasagkAwf8Wf_696lM3XkDHU-IiVZ5yV4jovAb0ss4WnYBNDp8Vx53cnDNU6dEyLE8dRy__skRRa6____BiRE8m3UEqvs46_DSFt41SmIJWs Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:34.382229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af388d6e63d641528e8f00de41c59490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af388d6e63d641528e8f00de41c59490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}] Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: d3235496c38249a388e4afc263eadbc3 Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. Sep 19 10:42:34.383927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '041b4a5e-774b-4a16-8082-d884ff033f63'} Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:34.384733 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. Sep 19 10:42:34.386270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:34.387736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Returning 404 to user: Instance 041b4a5e-774b-4a16-8082-d884ff033f63 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:34.387736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-30fa3e2b-8216-4c40-a6f7-257a57471043 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63" status: 404 len: 111 microversion: 2.1 time: 0.032274 Sep 19 10:42:34.387736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 464/907] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:34 2022] GET /compute/v2.1/servers/041b4a5e-774b-4a16-8082-d884ff033f63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:34.392740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b986c8fd-3b68-44fb-9a84-34b465245071 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '.version_select at 0x7fb94313e790>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:34.479098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b986c8fd-3b68-44fb-9a84-34b465245071 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094615004" status: 202 len: 0 microversion: 2.1 time: 0.090447 Sep 19 10:42:34.479922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 444/908] 10.222.0.42 () {58 vars in 1221 bytes} [Mon Sep 19 10:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094615004 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:42:34.542173 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:34.543053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:34.551835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.552815 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.553426 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.554459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.555869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.556528 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.729184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:34.730184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:34.745626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:34.762848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:34.764442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:34.765222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.765783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.766229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.766351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-cca506ad-da78-4ead-bc59-e9bf4a83ef61 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.230521 Sep 19 10:42:34.766951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:34.767189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 465/909] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:34 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:34.768401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:34.769112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:34.976209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:34.985256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-68b76ca1-7a64-4393-9b60-aea0e4874f7c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.264050 Sep 19 10:42:34.986468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 445/910] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:34 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:35.750203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:35.751092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:35.764299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:35.764882 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:35.765413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:35.766186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:35.766722 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:35.767210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:35.796374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:35.797130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:35.798417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:35.805854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:35.806604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:35.807255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:35.808294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:35.809378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:35.815293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:35.987419 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:35.997160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:35.998918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:36.000499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4aaafd2b-3813-4173-b84f-2ecb4006f946 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.208197 Sep 19 10:42:36.001791 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 446/911] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:35 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:36.014609 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:36.015584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:36.022805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:36.026531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:36.026531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:36.026531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:36.026531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:36.026963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:36.189510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-84896752-f04f-4b75-82ee-3716125d8803 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 204 len: 0 microversion: 2.1 time: 0.445590 Sep 19 10:42:36.191064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 466/912] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:35 2022] DELETE /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:42:36.197732 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:36.202207 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:36.203098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:36.209464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-948758c4-9ffd-4e7b-9ef4-713e2289de1c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.199129 Sep 19 10:42:36.210411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 447/913] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:36 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:36.227380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:36.228224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:36.229651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:36.230037 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:36.230681 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:36.231658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:36.413680 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:36.422132 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6e7cdc2e-4679-4c58-9635-02f2fc0d3005 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1513 microversion: 2.1 time: 0.225749 Sep 19 10:42:36.422694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 467/914] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:36 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:36.652487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "name": "network-vif-plugged", "status": "completed", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:36.670927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:36.672261 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:36.672805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:36.693194 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] Creating event network-vif-plugged:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:42:36.699262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-6a451c18-78f1-458d-bc56-15c039c68982 req-ff711b3f-f0e7-4aee-94e5-bd17b5d44ed3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256938 Sep 19 10:42:36.699995 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 448/915] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:37.028229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:37.028806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:37.035437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.042851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.043517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.044384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.044853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.045473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.236498 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:37.238090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:37.243238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:37.247068 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.251779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.252312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.253137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.253831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.256032 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:37.258435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:37.259120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.259913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-701ea079-8848-431f-91fc-c7b0a70c7bbd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.235913 Sep 19 10:42:37.266758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:37.271836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 468/916] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:37 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:37.409147 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:37.422919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-50e6b391-7638-4f6b-8103-424e2201a1fc tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.192167 Sep 19 10:42:37.423625 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 449/917] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:37 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:37.450574 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:37.451376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:37.464289 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.465621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.466118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.466925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:37.467437 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:37.467916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:37.637869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:37.647241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-252798d6-b632-4a55-8959-877080430202 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1513 microversion: 2.1 time: 0.201396 Sep 19 10:42:37.648113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 469/918] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:37 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:38.135830 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:38.136402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:38.143309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.143792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.144472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.145204 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.146590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.147043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.174932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:38.292380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:38.293218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:38.300409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.300987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.301578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.302510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.303013 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.303487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.511956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:38.521686 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:38.523778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:38.525361 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-608af633-7b3c-4a94-83f8-29c5751542cb tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.236967 Sep 19 10:42:38.527984 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 470/919] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:38 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:38.546225 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:38.547325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:38.557391 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.558616 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.558748 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.559940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.560366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.560842 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.737138 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-764bf46b-3a1d-404f-9bce-65031b5e1649 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 204 len: 0 microversion: 2.1 time: 0.605250 Sep 19 10:42:38.738411 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 450/920] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:38 2022] DELETE /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:42:38.745540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:38.746248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:38.756620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:38.761292 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.761783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.767167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.768146 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.768811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.769705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.772041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-199a2d85-e3a9-41dd-8d4a-cb4b86e24eb8 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.241543 Sep 19 10:42:38.772775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 471/921] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:38 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:38.780017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ba0f71-e73d-4922-b06f-8ccb43695e4f", "name": "network-vif-plugged", "status": "completed", "tag": "5403da25-9f83-4b67-bacf-db0017b912d5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:38.793542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.805418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.806041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.832542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] Creating event network-vif-plugged:5403da25-9f83-4b67-bacf-db0017b912d5 for instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f on hv-cinder-85827 Sep 19 10:42:38.842726 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-c842af0a-c188-4643-a8eb-03ba78051657 req-ae0c7ebc-4394-4c05-877c-5184810ff1cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Sep 19 10:42:38.847481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 472/922] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:38.853144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:38.866110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:38.878424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.878926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.879363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.885824 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.886370 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.886967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:38.933150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:38.943903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b7a20ea9-6f9d-4e58-b0fb-d74a85bbf0a2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1471 microversion: 2.1 time: 0.203894 Sep 19 10:42:38.944588 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 451/923] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:38 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:38.965717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca57dfc9-7e0d-41cd-be0d-c48e428d0c57", "name": "network-vif-deleted", "tag": "4947aaeb-197d-4a50-8259-2cfdc8f42ab7"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:38.980151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:38.983759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:38.984630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:38.985468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.091806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:39.105208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a0841521-249f-49e7-bd60-a39203be62d5 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1506 microversion: 2.1 time: 0.259619 Sep 19 10:42:39.127107 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 473/924] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:38 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:39.177635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] Creating event network-vif-deleted:4947aaeb-197d-4a50-8259-2cfdc8f42ab7 for instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 on hv-cinder-85827 Sep 19 10:42:39.183038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-de6edc2c-6892-4f75-94f0-d4e8f9c12b55 req-2513189f-e3ec-4fa6-ab0d-bf989d72b1b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225038 Sep 19 10:42:39.183567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 452/925] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:39.557715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:39.558352 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:39.566036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.566637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.567242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.568724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.569270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.569752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.736351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:39.750857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:39.752642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:39.754038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a2ac6fcb-7190-45ae-9a24-a8217880b8b4 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.203780 Sep 19 10:42:39.755552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 474/926] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:39 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:39.801740 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:39.803392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:39.825679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.825679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.825679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.827005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.827670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.828089 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.972010 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:39.974083 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:39.981689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.982360 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.982965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.983862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:39.986368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:39.986368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:39.999487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.009200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e05af6d1-8f70-4dc7-b359-79f7eb7e9edf tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.212333 Sep 19 10:42:40.010569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 453/927] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:39 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:40.071497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.084332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c10304b7-11f5-4ad2-b320-c4bc538cd8b2 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1471 microversion: 2.1 time: 0.117523 Sep 19 10:42:40.084952 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 475/928] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:39 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1471 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:40.128723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:40.129497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:40.135886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:40.136644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:40.137334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:40.138281 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:40.138948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:40.140700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:40.302144 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.309931 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f349f7d2-1426-4c4e-a3a0-6b5a84d72881 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1506 microversion: 2.1 time: 0.184925 Sep 19 10:42:40.323266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 454/929] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:40 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:40.787449 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:40.791292 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:40.799078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:40.799605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:40.800039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:40.800885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:40.801371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:40.802317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:40.959253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.970386 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.973395 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:40.974779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7ee07bb1-b299-453c-b19f-5dd7f743082f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.191687 Sep 19 10:42:40.975500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 476/930] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:40 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:41.041981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:41.043498 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:41.051050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.051524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.052022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.052981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.053459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.053876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.118093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:41.118771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:41.137243 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.137922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.138247 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.139058 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.139716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.140191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.232721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:41.244837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e2af8757-9c84-4ac8-872f-fc17e68eed43 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1471 microversion: 2.1 time: 0.133310 Sep 19 10:42:41.245863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 477/931] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:41 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1471 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:41.268840 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:41.291112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ec542f43-8784-4216-a5f6-65269d360a4d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.252975 Sep 19 10:42:41.291925 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 455/932] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:41 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:41.334762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:41.335433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:41.342447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.342992 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.343472 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.344278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:41.344778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:41.345336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:41.389705 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:41.598508 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:41.612294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-86fc2933-82ff-4314-a8d9-08f74e1b5d89 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1506 microversion: 2.1 time: 0.282455 Sep 19 10:42:41.625086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 478/933] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:41 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:42.004447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:42.005151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:42.011444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.011978 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.012432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.013276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.015511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.015511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.158315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bba45c57-1e1b-46ed-af10-3dee4b8dad0b", "name": "network-vif-deleted", "tag": "6967445f-4780-49ec-86c2-d13683e54272"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:42.172811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.173614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.174222 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.188670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] Creating event network-vif-deleted:6967445f-4780-49ec-86c2-d13683e54272 for instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b on hv-cinder-85827 Sep 19 10:42:42.195529 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-1aa55fef-64ba-48ec-8747-df14696016da req-612e2651-c279-46b4-a3cc-0613ac74982c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042754 Sep 19 10:42:42.200964 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 479/934] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:42.221590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.230540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.232311 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.233569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c86921de-726b-431b-8ab7-b41ea1da17ec tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.233112 Sep 19 10:42:42.241447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 456/935] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:41 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:42.270896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:42.271697 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:42.278124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.278695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.279219 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.279993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.280516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.281036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.315058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:42.316066 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:42.322244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.322832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.323359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.323568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.323949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lazy-loading 'fault' on Instance uuid ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:42.324434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.325047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.326217 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.326819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.327392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.372175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.382314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-28987311-df75-4981-9ab7-f16cea016a85 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1308 microversion: 2.1 time: 0.115869 Sep 19 10:42:42.383317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 480/936] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:42 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:42.541200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.552279 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-77b0cf51-0482-444c-a329-7e4c4555243e tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.240972 Sep 19 10:42:42.553099 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 457/937] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:42 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:42.640214 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:42.641362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:42.648224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.648790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.649345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.650123 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:42.650660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:42.651205 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:42.715233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:42.724330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-446a4bf3-69f7-481a-96e8-5f034ea69fc7 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1292 microversion: 2.1 time: 0.087804 Sep 19 10:42:42.725011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 481/938] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:42 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:43.260525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:43.261208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:43.271453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.271961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.272390 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.273106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.273557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.274164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.407605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:43.408379 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:43.419308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.419947 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.420483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.421398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.421524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.422047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.422570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.430996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.432422 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.433951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bfb1b341-cac2-4ba8-ac37-343f6a40c394 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.177548 Sep 19 10:42:43.434960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 458/939] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:43 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:43.463775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.464415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.464951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.465531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lazy-loading 'fault' on Instance uuid ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:43.539477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '884620036bb44462964db97238091c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b082859e089143dda3eefee066e4916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.548325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-dbb3c2e4-8cdf-4ea4-be67-ff4ad12a073f tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 200 len: 1308 microversion: 2.1 time: 0.145480 Sep 19 10:42:43.549003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 482/940] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:43 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:43.577578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:43.578730 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:43.585385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.586076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.586703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.589637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.589637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.589637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.748868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:43.749504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:43.756164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.756981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.757927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.759359 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.759956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.760843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.764717 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.773229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d6099641-8c58-49da-a137-a238ec772b90 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1365 microversion: 2.1 time: 0.199502 Sep 19 10:42:43.796022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 459/941] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:43 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:43.800665 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:43.801208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:43.802261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:43.805492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid bba45c57-1e1b-46ed-af10-3dee4b8dad0b {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:43.851619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:43.859233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-646a042f-f244-479b-a05c-8bcdadd384fe tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1311 microversion: 2.1 time: 0.114249 Sep 19 10:42:43.873631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 483/942] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:43 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1311 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:44.464644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:44.465541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:44.472000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.472494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.474750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.475613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.476088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.476518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.570959 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:44.571741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] [instance: ca57dfc9-7e0d-41cd-be0d-c48e428d0c57] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:44.584093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.584895 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.585546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.586493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.587139 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.587755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.603701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] HTTP exception thrown: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Request method failure captured: Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 HTTP/1.1 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEcW-uGDr8RlIo9aWw4efTFHbdVJMU6DSm3T1qRdotI9MoyNNtCgdKKXGDC34OASb-czTLU8p6o_LD5gtTJDTlxNHZ09FmI63k14Hh2Xk8cT-WzJ8IAt2XflOuCbXAkftSRAMqIFsYl5r7yO3JIAzcyv7QkVr33N-lG7DQZpODnG728 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: b082859e089143dda3eefee066e4916d Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:42:44.605799 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b082859e089143dda3eefee066e4916d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b082859e089143dda3eefee066e4916d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b082859e089143dda3eefee066e4916d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b082859e089143dda3eefee066e4916d"}]}] Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: b082859e089143dda3eefee066e4916d Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2142618770 Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesSnapshotTestJSON-2142618770-project Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 884620036bb44462964db97238091c19 Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesSnapshotTestJSON-2142618770-project Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. Sep 19 10:42:44.607404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'ca57dfc9-7e0d-41cd-be0d-c48e428d0c57'} Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:44.608299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. Sep 19 10:42:44.610510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:42:44.614015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] Returning 404 to user: Instance ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:44.615622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a268554f-8089-496d-a993-fcde365455c4 tempest-VolumesSnapshotTestJSON-2142618770 tempest-VolumesSnapshotTestJSON-2142618770-project] 10.222.0.42 "GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57" status: 404 len: 111 microversion: 2.1 time: 0.048585 Sep 19 10:42:44.616781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 484/943] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:44 2022] GET /compute/v2.1/servers/ca57dfc9-7e0d-41cd-be0d-c48e428d0c57 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:44.664243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:44.673680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:44.675467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:44.677111 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-573686db-0bdd-4b32-8e8b-88653c4cbb79 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.216405 Sep 19 10:42:44.685462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 460/944] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:44 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:44.796839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:44.797672 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:44.814101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.814691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.815253 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.816182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.816746 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.817673 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.884212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:44.884575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:44.904380 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.904977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.906169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.909330 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.909987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.910616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.955352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:44.955352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:44.955805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:44.956258 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid bba45c57-1e1b-46ed-af10-3dee4b8dad0b {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:45.046046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:45.056302 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cc8bd8f4-e94e-4e79-84d7-2370b65d611e tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 200 len: 1311 microversion: 2.1 time: 0.176621 Sep 19 10:42:45.061882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 461/945] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:44 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:45.070075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:45.080993 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7e21814f-5b53-4bb3-98c3-15f2db0f3745 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1555 microversion: 2.1 time: 0.288859 Sep 19 10:42:45.084307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 485/946] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:44 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:45.115703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:45.116977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:45.124630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.128321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.128321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.128321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.128321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.128699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.222100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6829709e-4593-42b7-861d-4a079c834bf7 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116679 Sep 19 10:42:45.222776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 462/947] 10.222.0.42 () {58 vars in 1275 bytes} [Mon Sep 19 10:42:45 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:45.705985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:45.707458 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:45.715568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.716182 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.716911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.717730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.718373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.718976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.731915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:45.732527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:45.743208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.743820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.744538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.747172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:45.747834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:45.748425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:45.808076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-47cd972f-4979-4deb-b205-407bd5189c9a tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/ips" status: 200 len: 146 microversion: 2.1 time: 0.082021 Sep 19 10:42:45.818566 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 463/948] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:42:45 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/ips => generated 146 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:45.945290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:45.957530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:45.960186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:45.961925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3d07d98f-860e-4538-a06f-fac12be4a8c8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.260438 Sep 19 10:42:45.977809 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 486/949] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:45 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:46.081293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:46.083845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: bba45c57-1e1b-46ed-af10-3dee4b8dad0b] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:46.090886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.091371 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.091819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.092674 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.093225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.093867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.112290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] HTTP exception thrown: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Request method failure captured: Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b HTTP/1.1 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEaAEpWevJa7FpLX7Feyysk1znYHiXN_UdOa63ocETlcpKwqN8cTVL0dgsXQO8sjKztfasagkAwf8Wf_696lM3XkDHU-IiVZ5yV4jovAb0ss4WnYBNDp8Vx53cnDNU6dEyLE8dRy__skRRa6____BiRE8m3UEqvs46_DSFt41SmIJWs Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:42:46.114424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af388d6e63d641528e8f00de41c59490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af388d6e63d641528e8f00de41c59490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}] Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d3235496c38249a388e4afc263eadbc3 Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. Sep 19 10:42:46.116090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'bba45c57-1e1b-46ed-af10-3dee4b8dad0b'} Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:46.116947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. Sep 19 10:42:46.118158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:46.120490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Returning 404 to user: Instance bba45c57-1e1b-46ed-af10-3dee4b8dad0b could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:46.121599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fed79274-ff61-4843-bec6-92541dd326b1 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b" status: 404 len: 111 microversion: 2.1 time: 0.045401 Sep 19 10:42:46.123749 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 464/950] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:46 2022] GET /compute/v2.1/servers/bba45c57-1e1b-46ed-af10-3dee4b8dad0b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:46.136070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:46.137666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:46.149422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.150345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.151003 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.152033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.152762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.153500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.182558 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:42:46.589453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d39b5baf-1e9f-4282-b313-9aa0780ec568 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "DELETE /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 204 len: 0 microversion: 2.1 time: 0.457315 Sep 19 10:42:46.593185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 487/951] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:42:46 2022] DELETE /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 10:42:46.600115 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:46.600828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:46.612893 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.613506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.614028 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.615065 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.615665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.616131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.870534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:46.875171 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ba0f71-e73d-4922-b06f-8ccb43695e4f", "tag": "5403da25-9f83-4b67-bacf-db0017b912d5"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:46.876368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:46.887457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-59312c91-c7ab-4ef8-8f58-880460c3cbf4 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.290423 Sep 19 10:42:46.887457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 465/952] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:46 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:46.891039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:46.891703 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:46.892291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:46.906572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] Creating event network-changed:5403da25-9f83-4b67-bacf-db0017b912d5 for instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f on hv-cinder-85827 Sep 19 10:42:46.917274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-41055cbe-a049-4e8d-8cbd-baa9020dbe17 req-cae21ee3-6527-4e30-8a01-d907447218c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043644 Sep 19 10:42:46.917274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 488/953] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:46.992638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:46.993278 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:47.000248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.000729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.001197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:47.001921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.002366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.002785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:47.154086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:47.164463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:47.165925 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:47.167106 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-79ef847e-fcfb-4903-8239-72fb81a494a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.179021 Sep 19 10:42:47.167866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 466/954] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:46 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:42:47.598014 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf2d678-eafb-43f9-bcdf-13cb1175fc64"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:47.600649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:47.607474 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.608050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.608554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:47.609371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.609897 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.610397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:47.908131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:47.908770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:47.916363 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.917160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.917810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:47.918854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:47.919494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:47.920199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:48.079347 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:48.089051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-19a17209-dea3-42c1-a452-deb9effc47ed tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.185164 Sep 19 10:42:48.089643 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 467/955] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:47 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:48.195680 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:48.196296 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:48.202290 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:48.202769 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:48.203201 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:48.203887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:48.204337 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:48.204760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:48.332079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:48.340548 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:48.342014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:48.343172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3f4d2241-f441-4148-a91c-bdaca1ef2147 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.151377 Sep 19 10:42:48.343723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 468/956] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:48 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:49.114006 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:49.114663 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:49.121856 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:49.122337 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:49.122765 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:49.123451 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:49.123899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:49.124315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:49.271530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:49.279944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9847ce3c-4ae6-470d-89ac-efc0f7f6d891 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.169816 Sep 19 10:42:49.280511 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 469/957] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:49 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:49.369155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:49.369936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:49.377326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:49.378109 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:49.378665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:49.379376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:49.380401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:49.380827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:49.532369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:49.540575 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:49.542045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:49.543215 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6a6cd119-779e-4f6f-a4e3-f2c076497baa tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.178907 Sep 19 10:42:49.543775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 470/958] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:49 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:50.304344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:50.304961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:50.311381 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:50.311861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:50.312751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:50.312971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:50.313453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:50.313956 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:50.452595 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:50.460779 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e4fbfab4-e727-4070-972e-43be9e6b0366 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.160307 Sep 19 10:42:50.461378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 471/959] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:50 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:50.569478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:50.570230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:50.576116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:50.576597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:50.577035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:50.577751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:50.578203 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:50.578632 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:50.715031 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:50.724592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:50.726268 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:50.727585 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8d31d1d1-566a-4f25-bbcf-06da51e790e7 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1741 microversion: 2.20 time: 0.162206 Sep 19 10:42:50.728250 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 472/960] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:50 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:51.485719 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:51.486349 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:51.494925 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:51.498514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:51.498514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:51.498514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:51.498514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:51.499078 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:51.627366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1b8bcc70-e6d9-4e37-a353-3484ea4e3a09 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.033676 Sep 19 10:42:51.630684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 489/961] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:42:47 2022] POST /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 194 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:51.755255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:51.756081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:51.762646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:51.766875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:51.766875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:51.766875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:51.766875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:51.767393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:51.795767 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:51.821077 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-72e8177c-5ff6-4ef9-a795-76a7a153cdea tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1522 microversion: 2.1 time: 0.340726 Sep 19 10:42:51.829969 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 473/962] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:51 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:51.933046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:51.941585 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:51.943150 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:51.944477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5b610bf3-c13b-483f-84bc-799e8b42ce81 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1723 microversion: 2.20 time: 0.194078 Sep 19 10:42:51.945509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 490/963] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:51 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:52.141693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964df96c-580f-4da3-b3b4-fcc5b7c1079c", "name": "network-vif-deleted", "tag": "c6f7c2e0-a7e1-4a33-9473-502c389dcbb0"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:52.157934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:52.158600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:52.159210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:52.174205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] Creating event network-vif-deleted:c6f7c2e0-a7e1-4a33-9473-502c389dcbb0 for instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c on hv-cinder-85827 Sep 19 10:42:52.180173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-3bf66890-8a49-4b41-9a06-683e51e9468d req-c7fd8e9f-cf32-4e36-a5f3-f386bfe8fd65 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043007 Sep 19 10:42:52.180878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 474/964] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:42:52.972665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:52.973618 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:52.980936 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:52.981333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:52.981776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:52.982461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:52.982915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:52.983336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:53.037852 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:53.040547 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:53.045316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:53.045876 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:53.046366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:53.047133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:53.047681 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:53.048303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:53.118557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:53.128077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bb0799fc-926c-41d8-9f92-f1e53e362e4c tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1307 microversion: 2.1 time: 0.280230 Sep 19 10:42:53.128730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 491/965] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:52 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1307 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:42:53.134148 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:53.142766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:53.144562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:53.146884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-47e4c994-d69c-4100-8ee2-bc883ad595a0 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1723 microversion: 2.20 time: 0.179073 Sep 19 10:42:53.147526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 475/966] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:52 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:54.154671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:54.155258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:54.162310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.162791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.163250 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.163938 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.164389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.164838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.175636 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:54.176226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:54.183352 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.183834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.184263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.184982 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.185461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.185883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.196423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.196912 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.197376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.197825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lazy-loading 'fault' on Instance uuid 964df96c-580f-4da3-b3b4-fcc5b7c1079c {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:42:54.257176 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3235496c38249a388e4afc263eadbc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af388d6e63d641528e8f00de41c59490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:54.262645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:42:54.269764 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7a3f2da8-a24a-44f2-8213-0ad1206bf6e2 tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 200 len: 1312 microversion: 2.1 time: 0.118669 Sep 19 10:42:54.271335 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 492/967] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:54 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 1312 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:42:54.346087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:54.356477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:54.360533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:54.360533 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fc52c35b-9617-41a1-9c56-7f7d1cd8dfdd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1723 microversion: 2.20 time: 0.188046 Sep 19 10:42:54.361696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 476/968] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:54 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:54.396903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "name": "network-vif-unplugged", "status": "completed", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:54.406743 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:54.407381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:54.407716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:54.420770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] Creating event network-vif-unplugged:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:42:54.425815 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-193eda62-e3b6-499b-b52a-dc8d366c308a req-0d0b9c77-0a95-447f-a584-15336bd809cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033195 Sep 19 10:42:54.426475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 493/969] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:42:55.298047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:55.298815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] [instance: 964df96c-580f-4da3-b3b4-fcc5b7c1079c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:55.306346 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.313044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.313044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:55.313044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.313044 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.313615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:55.324867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] HTTP exception thrown: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Request method failure captured: Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c HTTP/1.1 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEaAEpWevJa7FpLX7Feyysk1znYHiXN_UdOa63ocETlcpKwqN8cTVL0dgsXQO8sjKztfasagkAwf8Wf_696lM3XkDHU-IiVZ5yV4jovAb0ss4WnYBNDp8Vx53cnDNU6dEyLE8dRy__skRRa6____BiRE8m3UEqvs46_DSFt41SmIJWs Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:42:55.326733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/af388d6e63d641528e8f00de41c59490"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_af388d6e63d641528e8f00de41c59490", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/af388d6e63d641528e8f00de41c59490"}]}] Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: af388d6e63d641528e8f00de41c59490 Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903256377 Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d3235496c38249a388e4afc263eadbc3 Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903256377-project Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. Sep 19 10:42:55.328472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '964df96c-580f-4da3-b3b4-fcc5b7c1079c'} Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:42:55.329870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. Sep 19 10:42:55.331473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:42:55.337572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] Returning 404 to user: Instance 964df96c-580f-4da3-b3b4-fcc5b7c1079c could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:42:55.337572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-03027021-e9d1-41c3-934b-813e7a4aab4b tempest-ServerRescueNegativeTestJSON-1903256377 tempest-ServerRescueNegativeTestJSON-1903256377-project] 10.222.0.42 "GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c" status: 404 len: 111 microversion: 2.1 time: 0.034660 Sep 19 10:42:55.337572 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 477/970] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:42:55 2022] GET /compute/v2.1/servers/964df96c-580f-4da3-b3b4-fcc5b7c1079c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:42:55.392381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:55.393234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:55.401160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.401761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.402273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:55.403047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.403593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.404091 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:55.567836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:55.578078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:55.580101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:42:55.581518 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4c7e3a18-63dd-4a76-848a-4c8308fe3c1d tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1726 microversion: 2.20 time: 0.194530 Sep 19 10:42:55.582371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 494/971] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:42:55 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1726 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:42:55.611637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f029f22a-0698-46df-ba31-bcbaedcc3a1e"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:42:55.614927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:55.621856 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.622418 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.622928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:55.623781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:55.624305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:55.624798 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:56.925446 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0fc2497b-4c8f-44b1-bb83-4b2a59b61b1c tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.318428 Sep 19 10:42:56.932985 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 478/972] 10.222.0.42 () {62 vars in 1364 bytes} [Mon Sep 19 10:42:55 2022] POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments => generated 188 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 10:42:57.076781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:42:57.077530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:42:57.085512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:57.086061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:57.086701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:42:57.087419 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:42:57.087880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:42:57.088305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:00.033614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-495379c0-879b-414c-90dd-664ebf69d85e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments/f029f22a-0698-46df-ba31-bcbaedcc3a1e" status: 202 len: 0 microversion: 2.20 time: 2.961204 Sep 19 10:43:00.034318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 495/973] 10.222.0.42 () {60 vars in 1457 bytes} [Mon Sep 19 10:42:57 2022] DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments/f029f22a-0698-46df-ba31-bcbaedcc3a1e => generated 0 bytes in 2963 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:43:00.098100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:00.101876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:00.105567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:00.106060 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:00.106761 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:00.107596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:00.108057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:00.108545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:00.141712 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127497) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 10:43:00.499947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9553c0d7-1355-4f86-8301-13297b8032e5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/action" status: 202 len: 0 microversion: 2.20 time: 0.406586 Sep 19 10:43:00.502328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 479/974] 10.222.0.42 () {62 vars in 1319 bytes} [Mon Sep 19 10:43:00 2022] POST /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:43:00.512405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:00.513018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:00.520893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:00.521453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:00.522072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:00.527459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:00.527459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:00.527459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:00.688343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:00.699915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:00.701585 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:00.702890 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2e56126c-534f-4108-a1ba-f8e4dcbcfd52 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1674 microversion: 2.20 time: 0.195986 Sep 19 10:43:00.704869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 496/975] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:00 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:01.427293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:01.429733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:01.436222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.436906 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.437329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.438103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.438602 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.439073 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.444611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:01.475021 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8e7fac7d-822d-47f6-9cb4-c7ef624732b9 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052571 Sep 19 10:43:01.475876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 480/976] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:01 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:01.496595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:01.496595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:01.499638 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.501757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.502260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.502991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.503519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.504217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.557838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-728ba4b4-05ed-44d7-8444-d904cf1af902 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64" status: 200 len: 194 microversion: 2.1 time: 0.071357 Sep 19 10:43:01.557838 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 497/977] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 19 10:43:01 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:01.733649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:01.734256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:01.740549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.741032 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.741493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.742193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:01.742640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:01.743057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:01.889953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:01.898945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:01.899817 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:01.900999 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-873e32f5-8f59-4d86-b80b-1693bdec1ed9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1674 microversion: 2.20 time: 0.171679 Sep 19 10:43:01.901654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 481/978] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:01 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:02.926385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:02.927075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:02.929690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:02.934398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:02.934878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:02.935317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:02.936012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:02.936468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:02.936917 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:03.087160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:03.095469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:03.096910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:03.098113 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f02cea61-e227-46a3-8539-ee5bd8bcb3a2 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.175716 Sep 19 10:43:03.098758 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 498/979] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:02 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:03.224001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb8b48c-6591-41e4-ac08-cd6ac4d231fd"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:03.227175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:03.234785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:03.235334 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:03.235819 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:03.236897 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:03.237725 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:03.238387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:04.129550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:04.130832 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:04.137760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:04.141668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:04.141668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:04.141668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:04.141668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:04.142052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:04.282884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d3803e3f-d7a9-4776-96c6-f1571fd5acfe tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "POST /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.063162 Sep 19 10:43:04.284047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 482/980] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:43:03 2022] POST /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 194 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:04.301267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:04.311325 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:04.314353 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:04.315861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a8d3923c-bd47-4e70-85dd-dcf8ec8e6c72 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.190712 Sep 19 10:43:04.317833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 499/981] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:04 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:43:05.366235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:05.367052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:05.374391 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:05.375295 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:05.375941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:05.377080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:05.377732 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:05.378913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:05.572047 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:05.581317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:05.583973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:05.585731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-494c6199-5bd4-4b61-b5e4-8210e97db608 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.226900 Sep 19 10:43:05.586372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 483/982] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:05 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:06.616243 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:06.617940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:06.627595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:06.628155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:06.628649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:06.629477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:06.630476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:06.630950 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:06.806720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:06.822339 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:06.825163 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:06.831533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8384d09e-92d7-4613-b73b-8f669a118c1a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.220187 Sep 19 10:43:06.832138 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 500/983] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:06 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:07.859332 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:07.859986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:07.867647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:07.868441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:07.868919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:07.875640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:07.875640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:07.875640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:08.030289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:08.038613 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:08.040221 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:08.041262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c44002de-6a3b-46d6-a1df-5616e22944dc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.186149 Sep 19 10:43:08.041812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 484/984] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:07 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:09.074308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:09.097693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:09.097693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:09.097693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:09.097693 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:09.098909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:09.098909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:09.098909 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:09.260748 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:09.269887 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:09.271775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:09.274050 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b1393411-5fc2-4dbb-9bf0-f75537bc3ece tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.205332 Sep 19 10:43:09.274926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 501/985] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:09 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:10.304443 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:10.305345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:10.308128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:10.314150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:10.314834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:10.315515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:10.316322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:10.316894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:10.317536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:10.483801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:10.487459 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:10.489557 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:10.490876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0abdb2b9-ae23-44e5-b6b7-170ca88c81e8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.191813 Sep 19 10:43:10.491482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 485/986] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:10 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:11.527566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:11.527566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:11.535329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:11.535764 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:11.536259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:11.537038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:11.537566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:11.541569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:11.728094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:11.737334 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:11.739308 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:11.740760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0e097b90-5d0f-4288-83ea-431a49907747 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.225437 Sep 19 10:43:11.741349 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 502/987] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:11 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:12.777621 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:12.780225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:12.793500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:12.794304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:12.794896 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:12.795965 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:12.796803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:12.797449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:13.250987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:13.262112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:13.263945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:13.265620 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-72047b60-baed-4def-9cc6-6b92517e3101 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.495328 Sep 19 10:43:13.266337 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 486/988] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:12 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:14.294287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:14.300784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:14.303879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:14.304381 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:14.304822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:14.305579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:14.306035 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:14.306641 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:14.454927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:14.464480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:14.466189 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:14.467461 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-615c8702-4f57-485c-af31-cd948d66be1e tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.177361 Sep 19 10:43:14.468099 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 503/989] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:14 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:43:15.498610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:15.499208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:15.505922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:15.506402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:15.506834 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:15.507518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:15.507973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:15.508394 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:15.647182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:15.653692 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:15.655162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:15.656677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9e7a6674-446f-48a4-a509-ac40a5d56f94 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.162270 Sep 19 10:43:15.657285 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 487/990] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:15 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:16.683248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:16.684235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:16.690509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:16.690986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:16.691418 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:16.692150 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:16.692591 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:16.693009 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:16.828846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:16.836910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:16.838374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:16.839536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-67aeb8ea-3223-49cb-9718-91e52d1723a1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.160189 Sep 19 10:43:16.840096 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 504/991] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:16 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:17.863963 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:17.864552 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:17.871270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:17.871774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:17.872292 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:17.872984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:17.873470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:17.873893 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:18.023659 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:18.031687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:18.033218 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:18.034383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-242e2bb4-68a7-474b-a745-e08044c6a2bd tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.174531 Sep 19 10:43:18.034942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 488/992] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:17 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:19.059853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:19.060625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:19.068615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:19.069310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:19.070041 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:19.070867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:19.071436 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:19.071966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:19.217350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:19.228059 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:19.229969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:19.231586 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d0296559-de14-4c48-84e3-52a4b121a3a9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.176442 Sep 19 10:43:19.232498 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 505/993] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:19 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:19.983763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "name": "network-vif-plugged", "status": "completed", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:19.994738 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:19.995210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:19.995638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:20.009007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] Creating event network-vif-plugged:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:43:20.014204 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-17326d61-9b83-4b77-b35b-75af464913c5 req-468c6403-6ff1-4467-b62e-7c149e169bb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034240 Sep 19 10:43:20.014892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 489/994] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:20.261535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:20.262242 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:20.271072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:20.271507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:20.276160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:20.276160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:20.276160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:20.276160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:20.420192 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:20.430945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:20.432450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:20.433661 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-49d5cb78-ba1c-4391-935f-5f9b03b781cc tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.176029 Sep 19 10:43:20.434689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 506/995] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:20 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:21.464854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:21.465640 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:21.472979 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:21.474180 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:21.474768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:21.475631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:21.476241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:21.476758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:21.633492 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:21.642591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:21.644305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:21.646545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2087e8dc-0f7e-46bd-a98b-e8425a6f3663 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.187943 Sep 19 10:43:21.647177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 490/996] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:21 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:22.676881 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:22.677671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:22.684056 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:22.684538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:22.684970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:22.685720 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:22.686160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:22.686565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:22.846044 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:22.849403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:22.858012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:22.859902 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:22.861463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d86321b2-c70d-45cf-a59a-3e89db6cbc50 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1732 microversion: 2.20 time: 0.188555 Sep 19 10:43:22.862177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 507/997] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:22 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:23.892540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:23.893200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:23.901807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:23.902401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:23.902927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:23.903789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:23.904323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:23.904907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:24.052739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:24.061845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:24.063462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:24.064827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f9f5e1bd-a7cf-409f-9475-95f3c1ccbba5 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1719 microversion: 2.20 time: 0.177424 Sep 19 10:43:24.065497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 491/998] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:43:23 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:43:24.812394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:24.814949 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:24.822236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:24.822724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:24.823157 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:24.823846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:24.824297 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:24.824715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:24.855976 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-66137d09-7349-493a-87ed-f90322d66f04 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048093 Sep 19 10:43:24.856566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 508/999] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:24 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:24.998200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:24.998845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:25.005962 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.006499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.006986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.007774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.008262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.008745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.042243 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-889ec73f-01d6-46cb-8df8-02cd55c0b81c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64" status: 200 len: 194 microversion: 2.1 time: 0.048068 Sep 19 10:43:25.042995 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 492/1000] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 19 10:43:24 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:25.055819 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:25.056362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:25.063464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.064849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.064849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.065309 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.066058 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.066546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.151910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'services' on Instance uuid 18c94dcb-cdf9-4081-828d-7dea73061221 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:25.383095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ed229d1a-c122-47aa-a5c5-c49865ca4fc2 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64" status: 202 len: 0 microversion: 2.1 time: 0.331927 Sep 19 10:43:25.383710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 509/1001] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:43:25 2022] DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/bbf2d678-eafb-43f9-bcdf-13cb1175fc64 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:43:25.789402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:25.789839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:25.796077 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.796554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.796986 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.797706 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:25.798162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:25.798587 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:25.824323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b5fb06e4-87ca-480c-abfa-9aa9ccbc2358 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/ips" status: 200 len: 150 microversion: 2.1 time: 0.038806 Sep 19 10:43:25.826098 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 493/1002] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:43:25 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:27.570660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:27.571310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:27.575983 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdfe5b2-08cd-4b3b-be56-a0f54fdf692a"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:27.577775 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.578255 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.578922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.579356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:27.579598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.580199 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.580893 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.587547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.588130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.588661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.589520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.590254 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.590696 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.612849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0595aa63-2f41-4e08-990a-41e9dcbd1329 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/dcb8b48c-6591-41e4-ac08-cd6ac4d231fd" status: 200 len: 194 microversion: 2.1 time: 0.047705 Sep 19 10:43:27.613823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 510/1003] 10.222.0.42 () {58 vars in 1413 bytes} [Mon Sep 19 10:43:27 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/dcb8b48c-6591-41e4-ac08-cd6ac4d231fd => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:27.624064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:27.624759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:27.635303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.635303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.635303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.635303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:27.635708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:27.635708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:27.721262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'services' on Instance uuid 18c94dcb-cdf9-4081-828d-7dea73061221 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:28.044550 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1440cd96-2be0-4185-a9c1-4c6cdef0e778 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/dcb8b48c-6591-41e4-ac08-cd6ac4d231fd" status: 202 len: 0 microversion: 2.1 time: 0.424102 Sep 19 10:43:28.045509 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 511/1004] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:43:27 2022] DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments/dcb8b48c-6591-41e4-ac08-cd6ac4d231fd => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:43:28.529774 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-73960e01-05a3-4fb9-b14e-e8d1226b13a0 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "POST /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.958327 Sep 19 10:43:28.530383 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 494/1005] 10.222.0.42 () {60 vars in 1323 bytes} [Mon Sep 19 10:43:27 2022] POST /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments => generated 194 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:43:30.400005 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:30.402502 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:30.409389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.409924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.410412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.411795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.412294 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.412772 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.445487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f5d11062-d8c1-4df3-85b5-4139c4af90bd tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051684 Sep 19 10:43:30.446130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 512/1006] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:30 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:43:30.574444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:30.578894 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:30.586577 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.587058 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.587490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.588175 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.588624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.589051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.593289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:30.618884 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6bbab0f3-2fcd-4d31-adc1-d07a0474f2b1 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048837 Sep 19 10:43:30.619449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 495/1007] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:30 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:43:30.685632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:30.686129 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:30.692142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.692936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.693402 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.694101 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:30.694551 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:30.695089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:30.721039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:43:31.052230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-aca18d92-cd02-4729-aa22-83b215c6f214 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 204 len: 0 microversion: 2.1 time: 0.370132 Sep 19 10:43:31.053246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 513/1008] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:30 2022] DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:43:31.061440 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:31.062130 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:31.070092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:31.070590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:31.071056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:31.071992 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:31.072477 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:31.083526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:31.215583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:31.223763 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4aa092c6-2513-493a-98f3-80ad7fb2697c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1673 microversion: 2.1 time: 0.165691 Sep 19 10:43:31.224344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 496/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:31 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:32.248363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:32.249078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:32.255995 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:32.256477 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:32.256915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:32.257918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:32.264081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:32.264081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:32.395159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:32.403822 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6c7e8595-1f4a-4b44-b3f2-06001707a334 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1673 microversion: 2.1 time: 0.159715 Sep 19 10:43:32.404424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 514/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:32 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:33.427773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:33.428469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:33.434907 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:33.435396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:33.435830 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:33.436521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:33.436976 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:33.437428 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:33.639578 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:33.648011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8c65f915-2f98-4de8-8f5d-5ddcb92fffb7 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1673 microversion: 2.1 time: 0.224223 Sep 19 10:43:33.648700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 497/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:33 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:34.352276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c94dcb-cdf9-4081-828d-7dea73061221", "name": "network-vif-deleted", "tag": "227ea2cc-cd70-4dbb-9d73-32648cc95236"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:34.362989 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:34.363468 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:34.364483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:34.375913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] Creating event network-vif-deleted:227ea2cc-cd70-4dbb-9d73-32648cc95236 for instance 18c94dcb-cdf9-4081-828d-7dea73061221 on hv-cinder-85827 Sep 19 10:43:34.381030 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-64bc4a4b-0b9a-44e8-b8a0-1231f5788d1f req-7938cccf-c412-4af4-886a-85d46a8b31e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033466 Sep 19 10:43:34.382156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 515/1012] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:34.672669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:34.683151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:34.691189 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:34.694321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:34.694321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:34.694321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:34.694321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:34.695027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:34.734379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:34.734973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:34.735514 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:34.736063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'fault' on Instance uuid 18c94dcb-cdf9-4081-828d-7dea73061221 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:34.780708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:34.790088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c4d5be91-ff2c-4945-9bb0-e04e2e424014 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1327 microversion: 2.1 time: 0.122269 Sep 19 10:43:34.790753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 498/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:34 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:35.815374 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:35.815996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:35.823794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:35.824283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:35.824750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:35.825704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:35.825999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:35.826423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:35.858619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:35.859097 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:35.859530 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:35.860235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lazy-loading 'fault' on Instance uuid 18c94dcb-cdf9-4081-828d-7dea73061221 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:35.904014 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6712334ebb77462daa89be58d4480846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ec80c3417443d7b2368506bbd4a814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:35.911546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-04d2f403-3602-4bba-91a8-ddcc97024754 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 200 len: 1327 microversion: 2.1 time: 0.100450 Sep 19 10:43:35.912119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 516/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:35 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:36.936729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:36.937385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:36.944034 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:36.944512 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:36.949364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:36.949364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:36.949364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:36.949364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:36.960681 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 HTTP/1.1 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:36.962395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:36.963993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '18c94dcb-cdf9-4081-828d-7dea73061221'} Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:36.964809 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:36.966139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:36.967284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:36.967284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2e2fe0f3-13b1-42cf-9833-5979e99da190 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 404 len: 111 microversion: 2.1 time: 0.031179 Sep 19 10:43:36.967284 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 499/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:36 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:36.974702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7d86c258-c1fb-4fb2-9c75-0f6e2db52e2f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '.version_select at 0x7fb944ab1a60>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:36.982778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:37.069354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7d86c258-c1fb-4fb2-9c75-0f6e2db52e2f tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-456493980" status: 202 len: 0 microversion: 2.1 time: 0.099741 Sep 19 10:43:37.070013 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 517/1016] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 19 10:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-456493980 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:43:37.319899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:37.320392 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:37.326336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:37.326811 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:37.327249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:37.327994 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:37.328447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:37.328865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:37.414596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'services' on Instance uuid d9ba0f71-e73d-4922-b06f-8ccb43695e4f {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:37.701672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-03a06052-28a7-490e-aafa-a80077a22482 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments/3fdfe5b2-08cd-4b3b-be56-a0f54fdf692a" status: 202 len: 0 microversion: 2.1 time: 0.386546 Sep 19 10:43:37.702333 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 500/1017] 10.222.0.42 () {58 vars in 1416 bytes} [Mon Sep 19 10:43:37 2022] DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments/3fdfe5b2-08cd-4b3b-be56-a0f54fdf692a => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:43:37.711412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:37.713836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:37.721389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:37.721877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:37.722296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:37.723687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:37.724137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:37.724563 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:37.753674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c522b7ce-d278-4b56-886c-f44fce2b0d51 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Sep 19 10:43:37.754277 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 518/1018] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:37 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:43:38.768455 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:38.771704 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:38.778157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:38.780567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:38.780567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:38.780567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:38.780567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:38.780888 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:38.811711 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9c75141e-5250-4b64-b1fe-81bf619b2fc5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048375 Sep 19 10:43:38.815075 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 501/1019] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:38 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:39.825250 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:39.827507 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:39.834235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:39.834716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:39.835144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:39.835825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:39.836288 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:39.836735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:39.866692 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e7cca873-330b-4a58-910c-6aa65118e336 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045822 Sep 19 10:43:39.867368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 519/1020] 10.222.0.42 () {58 vars in 1302 bytes} [Mon Sep 19 10:43:39 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 10:43:39.931256 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:39.931760 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:39.938474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:39.938954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:39.939391 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:39.940079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:39.940536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:39.941125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:39.969958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:43:40.312545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0667370b-5a88-40e6-8d6d-ace512dca0aa tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 204 len: 0 microversion: 2.1 time: 0.385890 Sep 19 10:43:40.313177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 502/1021] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:39 2022] DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:43:40.322364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:40.323039 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:40.329480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:40.329907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:40.330345 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:40.331033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:40.331488 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:40.331913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:40.468943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:40.477606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6638df6a-15d2-4e0c-a90b-06ef415bc806 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1680 microversion: 2.1 time: 0.159216 Sep 19 10:43:40.478257 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 520/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:40 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:41.502517 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:41.503215 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:41.510166 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:41.510656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:41.511092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:41.511778 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:41.512230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:41.512652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:41.646412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:41.662343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-450e09be-940b-41c7-a18f-ba2bd03a58ca tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1680 microversion: 2.1 time: 0.156491 Sep 19 10:43:41.662343 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 503/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:41 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:42.684177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:42.684872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:42.691317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:42.691829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:42.692259 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:42.692945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:42.693416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:42.693843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:42.819687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:42.827340 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b12714a6-985a-4124-a926-e3be26d0e3ef tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1680 microversion: 2.1 time: 0.147031 Sep 19 10:43:42.827908 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 521/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:42 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:43.728165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:43.728712 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:43.735921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.736456 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.736945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:43.741828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.741828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.741828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:43.752934 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 HTTP/1.1 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:43.754785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.756366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '18c94dcb-cdf9-4081-828d-7dea73061221'} Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:43.757377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.758638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.759878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:43.759878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5a383425-c539-4cb1-ae06-bd48ea29cd4c tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 404 len: 111 microversion: 2.1 time: 0.033262 Sep 19 10:43:43.759878 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 504/1025] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:43 2022] DELETE /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:43.765387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:43.770835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: 18c94dcb-cdf9-4081-828d-7dea73061221] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:43.773950 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.774494 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.774985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:43.775757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.776272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.776789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:43.793809 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 HTTP/1.1 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:43.793930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.795485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '18c94dcb-cdf9-4081-828d-7dea73061221'} Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:43.796581 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. Sep 19 10:43:43.798735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:43.802094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance 18c94dcb-cdf9-4081-828d-7dea73061221 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:43.802094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3c0a09b8-5c2d-4f0a-bcd0-da8f14616b3b tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221" status: 404 len: 111 microversion: 2.1 time: 0.034217 Sep 19 10:43:43.802094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 522/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:43 2022] GET /compute/v2.1/servers/18c94dcb-cdf9-4081-828d-7dea73061221 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:43.852584 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:43.853234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:43.859045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.859526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.859960 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:43.860651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:43.861126 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:43.861550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:44.004861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:44.013335 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c2f31993-b6a0-4427-a884-827c939a4637 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1680 microversion: 2.1 time: 0.165211 Sep 19 10:43:44.014010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 505/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:43 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:45.038974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:45.039590 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:45.046135 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.046621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.047054 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.047760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.048226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.048763 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.065965 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:45.114234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:45.129808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7777cb8f-ce32-428d-b97b-5d2984a56932 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1613 microversion: 2.1 time: 0.090429 Sep 19 10:43:45.129808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 523/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:45 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:45.232892 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ba0f71-e73d-4922-b06f-8ccb43695e4f", "name": "network-vif-deleted", "tag": "5403da25-9f83-4b67-bacf-db0017b912d5"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:45.245512 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:45.246118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:45.253139 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.256740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.256740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.256740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.256740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.257124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.258523 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.259007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.259433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.277479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.281323 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] Creating event network-vif-deleted:5403da25-9f83-4b67-bacf-db0017b912d5 for instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f on hv-cinder-85827 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e HTTP/1.1 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:45.288333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.290094 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'fa2a3428-631d-490f-8f6b-23b4a1b0c30e'} Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:45.291007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.292538 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.295740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:45.295740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-625683ed-3c9e-49be-97eb-19973958390e tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 404 len: 111 microversion: 2.1 time: 0.046361 Sep 19 10:43:45.295740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 524/1029] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:45 2022] DELETE /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:45.296302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:45.297112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] [instance: fa2a3428-631d-490f-8f6b-23b4a1b0c30e] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:45.302417 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-bdaa761b-ec0c-4af0-b12a-281207772c69 req-71c75d72-38fe-4cda-b8ca-8a540891772d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070531 Sep 19 10:43:45.303580 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 506/1030] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:45.330879 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.331752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.331983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.332869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:45.333467 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:45.336888 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:45.364257 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] HTTP exception thrown: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Request method failure captured: Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e HTTP/1.1 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYxKmKnfZ0EMBo0GxMK0o0jc3DWZcc20NPkArG0sR5t7yDfOV__FCP5tKotgG--7QUAcyg06w5_IBfLVQJChOnxK4JGM0IrpVwfCaC6HZMAbAV0zrbTQpFWMZRCnx9-6E43W3ZaGXNCnMpJYPFFIFaLzD4QlJ5biJJuGnOK7R5oehA Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:45.366549 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_67ec80c3417443d7b2368506bbd4a814", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/67ec80c3417443d7b2368506bbd4a814"}]}] Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 67ec80c3417443d7b2368506bbd4a814 Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1276272895 Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 6712334ebb77462daa89be58d4480846 Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeTestJSON-1276272895-project Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.368664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'fa2a3428-631d-490f-8f6b-23b4a1b0c30e'} Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:45.370187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. Sep 19 10:43:45.371967 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:45.376317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] Returning 404 to user: Instance fa2a3428-631d-490f-8f6b-23b4a1b0c30e could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:45.377918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6cb38760-4ba9-4217-882c-367519424bd5 tempest-AttachVolumeTestJSON-1276272895 tempest-AttachVolumeTestJSON-1276272895-project] 10.222.0.42 "GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e" status: 404 len: 111 microversion: 2.1 time: 0.087069 Sep 19 10:43:45.379161 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 525/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:45 2022] GET /compute/v2.1/servers/fa2a3428-631d-490f-8f6b-23b4a1b0c30e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:43:46.155094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:46.156305 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:46.163605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:43:46.166597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:46.166597 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:46.167177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:46.168693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:46.169287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:46.169713 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:46.212087 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:46.212718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:46.213370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:46.213921 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lazy-loading 'fault' on Instance uuid d9ba0f71-e73d-4922-b06f-8ccb43695e4f {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:43:46.275596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a059ba74d744a12a4694513f8ca5789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e86736f46b254bc399298305a8888467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:43:46.284649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4450294b-c804-4ed4-a00a-754a80441bf5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 200 len: 1330 microversion: 2.1 time: 0.137488 Sep 19 10:43:46.285839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 507/1032] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:46 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:43:47.313950 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:47.314568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:47.322272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:47.322762 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:47.323194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:47.323885 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:47.324337 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:47.324761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:47.338980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f HTTP/1.1 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:47.340521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:47.342387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'd9ba0f71-e73d-4922-b06f-8ccb43695e4f'} Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:47.343376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:47.345036 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:47.346642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:47.346642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fe5222f1-d22c-49ff-a4a9-590940b42f50 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 404 len: 111 microversion: 2.1 time: 0.031931 Sep 19 10:43:47.346642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 526/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:47 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:47.353300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-83744122-6553-4975-9502-c397f494023c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '.version_select at 0x7fb9432764c0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:47.440998 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-83744122-6553-4975-9502-c397f494023c tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-780064073" status: 202 len: 0 microversion: 2.1 time: 0.093007 Sep 19 10:43:47.444121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 508/1034] 10.222.0.42 () {58 vars in 1218 bytes} [Mon Sep 19 10:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-780064073 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:43:49.692491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:49.693884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:49.701091 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:49.701645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:49.702097 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:49.702809 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:49.703265 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:49.703691 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f HTTP/1.1 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:49.731877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.733602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'd9ba0f71-e73d-4922-b06f-8ccb43695e4f'} Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:49.734475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.735872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.737307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:49.737307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f8e586ae-abb7-4459-8051-6d20f84a949b tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 404 len: 111 microversion: 2.1 time: 0.034541 Sep 19 10:43:49.737307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 527/1035] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:49 2022] DELETE /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:49.743611 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:49.744321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: d9ba0f71-e73d-4922-b06f-8ccb43695e4f] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:49.751531 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:49.752053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:49.752556 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:49.753506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:49.753902 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:49.754379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:49.767723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f HTTP/1.1 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:49.769416 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.778728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'd9ba0f71-e73d-4922-b06f-8ccb43695e4f'} Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:49.779653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. Sep 19 10:43:49.781232 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:49.783054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance d9ba0f71-e73d-4922-b06f-8ccb43695e4f could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:49.783054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2ac41d62-448d-498e-83c1-36e481426528 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f" status: 404 len: 111 microversion: 2.1 time: 0.034297 Sep 19 10:43:49.783054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 509/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:49 2022] GET /compute/v2.1/servers/d9ba0f71-e73d-4922-b06f-8ccb43695e4f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:51.172315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:51.172939 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:51.184301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.184301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.184301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.184301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.184814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.184814 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.199752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 HTTP/1.1 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:51.201761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.206022 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '63471bae-c8d3-4b0d-a78a-662fece52413'} Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:51.206777 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.208724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.210183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:51.210183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-24d0de3a-726b-419d-803d-8e6090541f9d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 404 len: 111 microversion: 2.1 time: 0.036555 Sep 19 10:43:51.210183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 528/1037] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:51 2022] DELETE /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:51.215241 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:51.216357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 63471bae-c8d3-4b0d-a78a-662fece52413] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:51.224563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.225041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.225494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.226188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.226637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.227052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.246439 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 HTTP/1.1 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:51.247989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.249601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '63471bae-c8d3-4b0d-a78a-662fece52413'} Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:51.250599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. Sep 19 10:43:51.252248 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.253705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 63471bae-c8d3-4b0d-a78a-662fece52413 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:51.253705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-45ebd9b9-2d02-4915-9765-a2c9004deb7d tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413" status: 404 len: 111 microversion: 2.1 time: 0.039356 Sep 19 10:43:51.253705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 510/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:51 2022] GET /compute/v2.1/servers/63471bae-c8d3-4b0d-a78a-662fece52413 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:51.258317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:51.258843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:51.264637 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.265146 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.265580 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.266261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.266713 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.267133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.281620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf HTTP/1.1 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:43:51.283149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.284741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'ff2a322d-06ff-40fa-8360-2df1f450bccf'} Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:51.286593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.288119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.289985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:51.289985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a86b8261-9e0d-4940-b11a-c4a1cdaea693 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 404 len: 111 microversion: 2.1 time: 0.030342 Sep 19 10:43:51.289985 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 529/1039] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:51 2022] DELETE /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:51.295020 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:51.295693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: ff2a322d-06ff-40fa-8360-2df1f450bccf] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:51.302209 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.302773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.303255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.304012 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:51.304520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:51.304993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:51.319913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf HTTP/1.1 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:51.321959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.323520 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'ff2a322d-06ff-40fa-8360-2df1f450bccf'} Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:51.324441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. Sep 19 10:43:51.326116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:51.327807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance ff2a322d-06ff-40fa-8360-2df1f450bccf could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:51.327807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2a0334bb-cf3e-415d-86c9-3bc2f6bcc824 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf" status: 404 len: 111 microversion: 2.1 time: 0.033241 Sep 19 10:43:51.327807 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 511/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:51 2022] GET /compute/v2.1/servers/ff2a322d-06ff-40fa-8360-2df1f450bccf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:51.877739 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c32ac079-e087-46d9-be1c-0a519869e60a tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Action: 'create', calling method: .version_select at 0x7fb9436c1700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1699601719"}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:52.612183 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c32ac079-e087-46d9-be1c-0a519869e60a tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.855166 Sep 19 10:43:52.612883 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 530/1041] 10.222.0.42 () {60 vars in 1155 bytes} [Mon Sep 19 10:43:51 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 856 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 10:43:52.628513 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:52.632891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:52.633040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3aa36888-c502-4de4-ae4c-21493e62cf91 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9433dbee0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:52.636051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:52.636536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:52.637084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:52.637792 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:52.638322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:52.638702 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:52.656889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d HTTP/1.1 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:52.658487 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.660108 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '2e7407bb-0aa4-4535-8b17-e90cd88cf96d'} Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:52.661619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.663276 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.666011 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:52.667076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-de26c8b3-abce-402d-a43c-c6f87fb08c30 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 404 len: 111 microversion: 2.1 time: 0.045156 Sep 19 10:43:52.669741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 512/1042] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:43:52 2022] DELETE /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:52.678900 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:52.679475 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] [instance: 2e7407bb-0aa4-4535-8b17-e90cd88cf96d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:43:52.685488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:52.686272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:52.688545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3aa36888-c502-4de4-ae4c-21493e62cf91 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 200 len: 345 microversion: 2.1 time: 0.062247 Sep 19 10:43:52.689137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 531/1043] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:43:52 2022] GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:43:52.689915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:52.690665 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:43:52.691131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:43:52.691607 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:43:52.707616 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] HTTP exception thrown: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Request method failure captured: Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d HTTP/1.1 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEYteUMkEKxK-sz1M11IcHeNZmAwE-0PHt0C1KzXGVwOTQFDy8PVRbVD57Kers3_ox1-BxepUibTKb6I9Jy9tn6ZN7fsuPQOTYOqOYHcIoobJHzgGtJDXNfK0awnQThW3YrfzUXit6xn32Hj-pI9Jdu4HKjuXPPLo1HdSjG97C5OlkY Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:52.710872 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e86736f46b254bc399298305a8888467"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e86736f46b254bc399298305a8888467", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e86736f46b254bc399298305a8888467"}]}] Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e86736f46b254bc399298305a8888467 Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-74090900 Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8a059ba74d744a12a4694513f8ca5789 Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeNegativeTest-74090900-project Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.712709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '2e7407bb-0aa4-4535-8b17-e90cd88cf96d'} Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:52.713780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. Sep 19 10:43:52.715427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:52.717045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] Returning 404 to user: Instance 2e7407bb-0aa4-4535-8b17-e90cd88cf96d could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:52.717045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1023563-786f-453f-a78b-b2e206d022e5 tempest-AttachVolumeNegativeTest-74090900 tempest-AttachVolumeNegativeTest-74090900-project] 10.222.0.42 "GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d" status: 404 len: 111 microversion: 2.1 time: 0.036521 Sep 19 10:43:52.717045 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 513/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:43:52 2022] GET /compute/v2.1/servers/2e7407bb-0aa4-4535-8b17-e90cd88cf96d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:53.703332 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-39eed45e-0f06-4b17-8fcf-1f496fb0c592 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9433adf70>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:53.758724 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-39eed45e-0f06-4b17-8fcf-1f496fb0c592 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 200 len: 346 microversion: 2.1 time: 0.059940 Sep 19 10:43:53.759329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 532/1045] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:43:53 2022] GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:53.774036 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-766c6bcb-08fb-4840-8d4e-c6c784ae3e9f tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Action: 'create', calling method: .version_select at 0x7fb94325d0d0>, body: {"snapshot": {"volume_id": "df19e09c-9d8c-4382-bd55-00f36064614a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1718693913"}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:43:54.304652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-766c6bcb-08fb-4840-8d4e-c6c784ae3e9f tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.535654 Sep 19 10:43:54.311875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 514/1046] 10.222.0.42 () {60 vars in 1162 bytes} [Mon Sep 19 10:43:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:54.317896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5dfc0e38-1ddc-422c-9792-2482b95cc44b tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9430b19d0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:54.360981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5dfc0e38-1ddc-422c-9792-2482b95cc44b tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.048206 Sep 19 10:43:54.366324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 533/1047] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:54 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:54.376208 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a97e5396-a5bf-4172-9dec-8e7476d0708e tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9432320d0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:54.424306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a97e5396-a5bf-4172-9dec-8e7476d0708e tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.055397 Sep 19 10:43:54.424919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 515/1048] 10.222.0.42 () {58 vars in 1140 bytes} [Mon Sep 19 10:43:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:54.437346 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e1ebc076-3ce8-44ff-bfe7-875ae3d859f6 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb943435af0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:54.475615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e1ebc076-3ce8-44ff-bfe7-875ae3d859f6 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.042230 Sep 19 10:43:54.476188 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 534/1049] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:54 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:43:55.489424 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0056adb6-086d-4d9d-8a39-bd58edd60704 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb943232310>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:55.543076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0056adb6-086d-4d9d-8a39-bd58edd60704 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.059012 Sep 19 10:43:55.543721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 516/1050] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:55 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:56.557740 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b699c27f-6f58-4525-92fa-7055c7a422e9 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb94363fe50>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:56.612849 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b699c27f-6f58-4525-92fa-7055c7a422e9 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.058748 Sep 19 10:43:56.615991 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 535/1051] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:56 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:57.629421 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-176a4bdb-f01c-4598-876d-7f6b8026e6c5 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb943276820>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:57.662622 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-176a4bdb-f01c-4598-876d-7f6b8026e6c5 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.038559 Sep 19 10:43:57.663472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 517/1052] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:57 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:58.676435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e8b02a5d-b32b-4060-a536-8cf5b22cc0ef tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9436c1700>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:58.706806 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e8b02a5d-b32b-4060-a536-8cf5b22cc0ef tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 288 microversion: 2.1 time: 0.034473 Sep 19 10:43:58.712732 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 536/1053] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:58 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:58.721310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4b0fbc94-c032-49da-aacc-be4e60ba5a84 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb94325d4c0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:58.873691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4b0fbc94-c032-49da-aacc-be4e60ba5a84 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 202 len: 0 microversion: 2.1 time: 0.157722 Sep 19 10:43:58.874683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 518/1054] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Sep 19 10:43:58 2022] DELETE /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:43:58.882747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b5161f88-3c00-46b7-aa65-19ce1f38946a tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9433db430>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:58.920230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b5161f88-3c00-46b7-aa65-19ce1f38946a tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 200 len: 287 microversion: 2.1 time: 0.041385 Sep 19 10:43:58.920800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 537/1055] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:58 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:43:59.934466 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f67508f4-ab8c-4586-b25f-d8475c3fe32c tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb943276e50>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:43:59.962353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-f67508f4-ab8c-4586-b25f-d8475c3fe32c tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] HTTP exception thrown: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f67508f4-ab8c-4586-b25f-d8475c3fe32c tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Request method failure captured: Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba HTTP/1.1 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEfnrtrswNen_0jLwbOeg3q0UTaHPYc-7q022ilV7Z1DxrdEugX8EqtbY06AyEEOtmOiTb96BGy1PAc_HPoCIq0-vfbK8BHkWOnqk0ajs2OvUZ1o8HRMHJziHmTVSTDJ0gcgy2Q71HnGWxVvZbxi4baGPb1vHchS3PPMQOp_FExn0A8 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:43:59.964783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e4413bdac283489b86d9059967e509a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e4413bdac283489b86d9059967e509a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}] Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8ac49bfdb25344daaecd623a1b8ef9ad Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '1ee6cc36-2cf9-46af-b63a-c0d4ca536fba'} Sep 19 10:43:59.966473 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. (HTTP 404) (Request-ID: req-6b6c111e-e4eb-41da-8a61-419f8bc3373f) Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.967850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:43:59.969010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 10:43:59.970476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f67508f4-ab8c-4586-b25f-d8475c3fe32c tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Returning 404 to user: Snapshot 1ee6cc36-2cf9-46af-b63a-c0d4ca536fba could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:43:59.971796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f67508f4-ab8c-4586-b25f-d8475c3fe32c tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba" status: 404 len: 111 microversion: 2.1 time: 0.037567 Sep 19 10:43:59.972800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 519/1056] 10.222.0.42 () {58 vars in 1251 bytes} [Mon Sep 19 10:43:59 2022] GET /compute/v2.1/os-snapshots/1ee6cc36-2cf9-46af-b63a-c0d4ca536fba => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:43:59.976405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e00aa023-87c1-48e8-bd51-b59185c1ad77 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9433803a0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:00.222435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e00aa023-87c1-48e8-bd51-b59185c1ad77 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 202 len: 0 microversion: 2.1 time: 0.250395 Sep 19 10:44:00.223413 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 538/1057] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:43:59 2022] DELETE /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:44:00.231573 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a8597b8c-e7ce-4a2e-86f8-005ec5ca3a1e tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9432b5310>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:00.280210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a8597b8c-e7ce-4a2e-86f8-005ec5ca3a1e tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 200 len: 345 microversion: 2.1 time: 0.052378 Sep 19 10:44:00.280768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 520/1058] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:00 2022] GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:01.292621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:01.293416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=15 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:01.297475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7e571cbe-d32a-459c-a834-09e327382d37 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb9433adc10>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:01.329034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-7e571cbe-d32a-459c-a834-09e327382d37 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] HTTP exception thrown: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7e571cbe-d32a-459c-a834-09e327382d37 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Request method failure captured: Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a HTTP/1.1 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEfnrtrswNen_0jLwbOeg3q0UTaHPYc-7q022ilV7Z1DxrdEugX8EqtbY06AyEEOtmOiTb96BGy1PAc_HPoCIq0-vfbK8BHkWOnqk0ajs2OvUZ1o8HRMHJziHmTVSTDJ0gcgy2Q71HnGWxVvZbxi4baGPb1vHchS3PPMQOp_FExn0A8 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:44:01.345100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e4413bdac283489b86d9059967e509a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e4413bdac283489b86d9059967e509a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}] Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8ac49bfdb25344daaecd623a1b8ef9ad Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'df19e09c-9d8c-4382-bd55-00f36064614a'} Sep 19 10:44:01.346900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. (HTTP 404) (Request-ID: req-b02ec2d6-64dc-43cb-ac8a-f243f90195c0) Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.348084 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:44:01.349812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 10:44:01.351430 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7e571cbe-d32a-459c-a834-09e327382d37 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Returning 404 to user: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7e571cbe-d32a-459c-a834-09e327382d37 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 404 len: 109 microversion: 2.1 time: 0.055496 Sep 19 10:44:01.353169 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 539/1059] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:01 2022] GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:44:01.362225 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-265bb3c0-8f87-42ed-a967-a9cb5cc43da0 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb943276040>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:01.392185 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-265bb3c0-8f87-42ed-a967-a9cb5cc43da0 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] HTTP exception thrown: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-265bb3c0-8f87-42ed-a967-a9cb5cc43da0 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Request method failure captured: Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: DELETE /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a HTTP/1.1 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEfnrtrswNen_0jLwbOeg3q0UTaHPYc-7q022ilV7Z1DxrdEugX8EqtbY06AyEEOtmOiTb96BGy1PAc_HPoCIq0-vfbK8BHkWOnqk0ajs2OvUZ1o8HRMHJziHmTVSTDJ0gcgy2Q71HnGWxVvZbxi4baGPb1vHchS3PPMQOp_FExn0A8 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:44:01.395184 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e4413bdac283489b86d9059967e509a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e4413bdac283489b86d9059967e509a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}] Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 8ac49bfdb25344daaecd623a1b8ef9ad Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'df19e09c-9d8c-4382-bd55-00f36064614a'} Sep 19 10:44:01.402716 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. (HTTP 404) (Request-ID: req-df44a7f2-4e56-49e0-9c3d-895196ed414f) Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.403739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 10:44:01.405200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 10:44:01.406675 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-265bb3c0-8f87-42ed-a967-a9cb5cc43da0 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Returning 404 to user: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-265bb3c0-8f87-42ed-a967-a9cb5cc43da0 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 404 len: 109 microversion: 2.1 time: 0.040136 Sep 19 10:44:01.408169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 521/1060] 10.222.0.42 () {58 vars in 1248 bytes} [Mon Sep 19 10:44:01 2022] DELETE /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:44:01.409855 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5f82192c-0b98-411a-a5be-d3505c166750 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Calling method '.version_select at 0x7fb94337b700>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:01.440386 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-5f82192c-0b98-411a-a5be-d3505c166750 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] HTTP exception thrown: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5f82192c-0b98-411a-a5be-d3505c166750 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Request method failure captured: Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a HTTP/1.1 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEfnrtrswNen_0jLwbOeg3q0UTaHPYc-7q022ilV7Z1DxrdEugX8EqtbY06AyEEOtmOiTb96BGy1PAc_HPoCIq0-vfbK8BHkWOnqk0ajs2OvUZ1o8HRMHJziHmTVSTDJ0gcgy2Q71HnGWxVvZbxi4baGPb1vHchS3PPMQOp_FExn0A8 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:44:01.443155 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e4413bdac283489b86d9059967e509a6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e4413bdac283489b86d9059967e509a6", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e4413bdac283489b86d9059967e509a6"}]}] Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e4413bdac283489b86d9059967e509a6 Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-267480478 Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 8ac49bfdb25344daaecd623a1b8ef9ad Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-267480478-project Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'df19e09c-9d8c-4382-bd55-00f36064614a'} Sep 19 10:44:01.444790 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. (HTTP 404) (Request-ID: req-c15129fd-2d37-48c3-a45d-fe5866f415aa) Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.446368 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 10:44:01.448387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 10:44:01.450432 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5f82192c-0b98-411a-a5be-d3505c166750 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] Returning 404 to user: Volume df19e09c-9d8c-4382-bd55-00f36064614a could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5f82192c-0b98-411a-a5be-d3505c166750 tempest-VolumesSnapshotsTestJSON-267480478 tempest-VolumesSnapshotsTestJSON-267480478-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a" status: 404 len: 109 microversion: 2.1 time: 0.041358 Sep 19 10:44:01.453546 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 540/1061] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:01 2022] GET /compute/v2.1/os-volumes/df19e09c-9d8c-4382-bd55-00f36064614a => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:44:04.221361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:04.225181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:04.227741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:04.228463 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:04.233697 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.234234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.234721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:04.235506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.236004 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.236483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:04.268391 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-63aea070-dc9e-4d7d-b946-055897fd45f8 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051995 Sep 19 10:44:04.269085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 522/1062] 10.222.0.42 () {60 vars in 1343 bytes} [Mon Sep 19 10:44:04 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:44:04.345316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:04.345848 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:04.356069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.356613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.357158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:04.358217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.358730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.359405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:04.389459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:44:04.862622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7895b401-2fca-4800-b392-2cb4c69ce91f tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 204 len: 0 microversion: 2.20 time: 0.521564 Sep 19 10:44:04.863445 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 541/1063] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 19 10:44:04 2022] DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 10:44:04.871336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:04.871945 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:04.879361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.879846 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.880282 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:04.880973 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:04.881457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:04.881881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:05.021886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:05.033432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:05.034889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:05.036309 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f04dc981-06f8-4206-8b9d-bce96c488f45 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.168753 Sep 19 10:44:05.036750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 523/1064] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:04 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 10:44:06.063707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:06.064397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:06.071448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:06.071926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:06.072358 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:06.073046 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:06.076837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:06.076837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:06.249260 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:06.258679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:06.260756 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:06.262263 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-55c827d0-f93e-48d5-9151-a6aa0d87734a tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1725 microversion: 2.20 time: 0.202965 Sep 19 10:44:06.262922 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 542/1065] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:06 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:44:07.290672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:07.292023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:07.299263 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:07.299992 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:07.300743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:07.301866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:07.302555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:07.303188 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:07.407685 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:07.415753 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:07.417212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:07.418449 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-5f8dfbc0-0073-4d26-bdbb-9040bba7e4b1 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1657 microversion: 2.20 time: 0.131732 Sep 19 10:44:07.419001 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 524/1066] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:07 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1657 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:44:07.690075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e10a45-f231-4231-a5de-a46e49d7ccf2", "name": "network-vif-deleted", "tag": "ba7ea05f-242c-4a1e-a30f-00d0880b8f37"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:44:07.703234 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:07.703903 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:07.704425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:07.725210 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] Creating event network-vif-deleted:ba7ea05f-242c-4a1e-a30f-00d0880b8f37 for instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 on hv-cinder-85827 Sep 19 10:44:07.725500 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-14458547-721d-4f6a-8c66-eea328b91e49 req-b4a8d701-5d36-4d69-9352-a1afe6b23daf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043256 Sep 19 10:44:07.726000 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 543/1067] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:08.449545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:08.450260 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:08.459170 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:08.459914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:08.460116 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:08.460841 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:08.461324 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:08.461752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:08.499881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:08.500445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:08.500883 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:08.501357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lazy-loading 'fault' on Instance uuid c0e10a45-f231-4231-a5de-a46e49d7ccf2 {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:44:08.572493 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:08.600177 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:08.602315 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4d9bea213fa4401992d8e7894726e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3160b641b81433780d38eca696bfdf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:44:08.603693 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-85c19adc-d9ed-4d37-b656-094e342097ac tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 200 len: 1371 microversion: 2.20 time: 0.159594 Sep 19 10:44:08.604612 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 525/1068] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:08 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 10:44:09.640961 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:09.641821 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:09.649307 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:09.650159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:09.650857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:09.651875 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:09.652889 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:09.653089 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:09.669596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 HTTP/1.1 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:44:09.671531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:09.678357 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'c0e10a45-f231-4231-a5de-a46e49d7ccf2'} Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:09.679305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:09.680682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:09.682052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:09.682052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e815995a-1fc5-4979-94cf-cb78bfdcec93 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 404 len: 111 microversion: 2.20 time: 0.037802 Sep 19 10:44:09.682052 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 544/1069] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:09 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:44:09.686174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-dc31872d-498e-4ace-94ea-320bf9b99c77 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '.version_select at 0x7fb943224160>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:09.822483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-dc31872d-498e-4ace-94ea-320bf9b99c77 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959923239" status: 204 len: 0 microversion: 2.20 time: 0.132895 Sep 19 10:44:09.822483 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 526/1070] 10.222.0.42 () {60 vars in 1259 bytes} [Mon Sep 19 10:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959923239 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 10:44:12.427642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:12.428351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:12.434851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:12.435248 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:12.435689 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:12.436380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:12.436837 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:12.437303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:12.450940 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 HTTP/1.1 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:44:12.452490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.454218 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'c0e10a45-f231-4231-a5de-a46e49d7ccf2'} Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:12.455142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.456612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.458178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:12.458178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0c6f8989-19fe-47de-bbc5-207e5288f233 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 404 len: 111 microversion: 2.20 time: 0.030307 Sep 19 10:44:12.458178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 545/1071] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 19 10:44:12 2022] DELETE /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:44:12.464162 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:12.464828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: c0e10a45-f231-4231-a5de-a46e49d7ccf2] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:12.472229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:12.472229 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:12.472491 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:12.473201 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:12.473683 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:12.474100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:12.487464 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 HTTP/1.1 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:44:12.489040 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.490783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'c0e10a45-f231-4231-a5de-a46e49d7ccf2'} Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:12.491776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. Sep 19 10:44:12.493134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:12.494550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance c0e10a45-f231-4231-a5de-a46e49d7ccf2 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:12.494550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ff10ecaa-a1fb-40b6-99c9-168b0c7be7f6 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2" status: 404 len: 111 microversion: 2.20 time: 0.031912 Sep 19 10:44:12.494550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 527/1072] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:12 2022] GET /compute/v2.1/servers/c0e10a45-f231-4231-a5de-a46e49d7ccf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:44:13.860356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:13.861768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:13.869782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:13.870496 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:13.871153 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:13.871857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:13.872310 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:13.872916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d HTTP/1.1 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:44:13.891147 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.892948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': '784aab17-65f2-41da-97ef-e294b0a9713d'} Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:13.893839 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.895470 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.897377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:13.897377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-22a750f4-5143-45c8-afe0-058311938720 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 404 len: 111 microversion: 2.20 time: 0.037544 Sep 19 10:44:13.897377 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 546/1073] 10.222.0.42 () {60 vars in 1280 bytes} [Mon Sep 19 10:44:13 2022] DELETE /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:44:13.902699 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:13.903541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] [instance: 784aab17-65f2-41da-97ef-e294b0a9713d] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:44:13.909673 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:13.910235 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:13.910759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:13.911524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:44:13.912056 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:44:13.912554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:44:13.926402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] HTTP exception thrown: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Request method failure captured: Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d HTTP/1.1 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEY1Ecw5mvEezD0CA_tyGTYYzZV9VbCcJEHdONmibI1XVtN0VFCmGOcC3PEfYhvQl5wokXmmiX4MY2Nf5FDHJllNaHOVtdm6Dzn5MJZLeX06OrZ-OE3hK7omKsLitdRwdMA3XfSnFwbaRuugpBF3xyRWQYo5Jt7ySG7PvSlgdWlCbJ8 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:44:13.927948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e3160b641b81433780d38eca696bfdf1", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e3160b641b81433780d38eca696bfdf1"}]}] Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: e3160b641b81433780d38eca696bfdf1 Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-76682510 Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: d4d9bea213fa4401992d8e7894726e05 Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-AttachVolumeShelveTestJSON-76682510-project Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.929748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '784aab17-65f2-41da-97ef-e294b0a9713d'} Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:44:13.930600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. Sep 19 10:44:13.932163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:44:13.933586 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] Returning 404 to user: Instance 784aab17-65f2-41da-97ef-e294b0a9713d could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:44:13.933586 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-cf1a7e27-41cb-4224-8b95-6f117313eee9 tempest-AttachVolumeShelveTestJSON-76682510 tempest-AttachVolumeShelveTestJSON-76682510-project] 10.222.0.42 "GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d" status: 404 len: 111 microversion: 2.20 time: 0.031098 Sep 19 10:44:13.933586 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 528/1074] 10.222.0.42 () {60 vars in 1277 bytes} [Mon Sep 19 10:44:13 2022] GET /compute/v2.1/servers/784aab17-65f2-41da-97ef-e294b0a9713d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 10:44:22.902066 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bcc0fe41-756e-4289-85e1-70be23de7a1e tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9432371f0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:22.982611 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bcc0fe41-756e-4289-85e1-70be23de7a1e tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/e379b4cf-552d-43c0-b7df-9715c1eac5dd" status: 200 len: 351 microversion: 2.1 time: 0.084723 Sep 19 10:44:22.983206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 547/1075] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:22 2022] GET /compute/v2.1/os-volumes/e379b4cf-552d-43c0-b7df-9715c1eac5dd => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:26.780402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-52e9ae90-aa28-47a9-b7cc-654db9a28ae2 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9433f0dc0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:26.795745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:26.795745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=30 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:26.859690 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-52e9ae90-aa28-47a9-b7cc-654db9a28ae2 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/ae8db047-9263-4241-b7ab-142207b82458" status: 200 len: 351 microversion: 2.1 time: 0.083137 Sep 19 10:44:26.860267 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 529/1076] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:26 2022] GET /compute/v2.1/os-volumes/ae8db047-9263-4241-b7ab-142207b82458 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:44:30.727059 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:30.728143 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:44:30.732495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a08c8d12-00dd-4b6c-8b1b-68fecdceb7e0 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9433f9820>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:30.782632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a08c8d12-00dd-4b6c-8b1b-68fecdceb7e0 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/2b547b4b-e393-411e-a380-852a86e9dcfc" status: 200 len: 350 microversion: 2.1 time: 0.056310 Sep 19 10:44:30.783884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 548/1077] 10.222.0.42 () {58 vars in 1245 bytes} [Mon Sep 19 10:44:30 2022] GET /compute/v2.1/os-volumes/2b547b4b-e393-411e-a380-852a86e9dcfc => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:30.797505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ab7b2a26-13a8-4652-aa12-b578d718029c tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb943276550>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:30.883351 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ab7b2a26-13a8-4652-aa12-b578d718029c tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090125 Sep 19 10:44:30.883958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 530/1078] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Sep 19 10:44:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:44:30.899539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-12664d89-c3ad-4a24-be5c-7ff704e29eb1 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb94363fe50>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:30.988177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-12664d89-c3ad-4a24-be5c-7ff704e29eb1 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093313 Sep 19 10:44:30.988829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 549/1079] 10.222.0.42 () {58 vars in 1149 bytes} [Mon Sep 19 10:44:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:31.003353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f134b345-2450-452f-9b33-afdfa4047f25 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb943276e50>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.086546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f134b345-2450-452f-9b33-afdfa4047f25 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087435 Sep 19 10:44:31.087118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 531/1080] 10.222.0.42 () {58 vars in 1134 bytes} [Mon Sep 19 10:44:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:44:31.100717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-afcdf29f-9b69-4675-ab37-02948491881e tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9430643a0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.185850 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-afcdf29f-9b69-4675-ab37-02948491881e tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089274 Sep 19 10:44:31.186428 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 550/1081] 10.222.0.42 () {58 vars in 1167 bytes} [Mon Sep 19 10:44:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:31.201092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f3ca3bb3-85ac-4a67-b9a5-f63d1c2ca76b tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb94327a550>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.282843 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f3ca3bb3-85ac-4a67-b9a5-f63d1c2ca76b tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085445 Sep 19 10:44:31.283378 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 532/1082] 10.222.0.42 () {58 vars in 1170 bytes} [Mon Sep 19 10:44:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:31.297081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-18566b3f-8974-4aa5-bc77-89d9d487a81b tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb94307f4c0>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.380085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-18566b3f-8974-4aa5-bc77-89d9d487a81b tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086750 Sep 19 10:44:31.380678 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 551/1083] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Sep 19 10:44:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:44:31.394479 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6f32976a-c8c5-45a2-895a-a0b6106761cd tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9432ff700>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.476898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6f32976a-c8c5-45a2-895a-a0b6106761cd tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086280 Sep 19 10:44:31.477516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 533/1084] 10.222.0.42 () {58 vars in 1188 bytes} [Mon Sep 19 10:44:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:44:31.491495 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-25f676d0-b938-44c7-ace0-78ea99623bd0 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] Calling method '.version_select at 0x7fb9433f9e50>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:44:31.573684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-25f676d0-b938-44c7-ace0-78ea99623bd0 tempest-VolumesTestJSON-1527110383 tempest-VolumesTestJSON-1527110383-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085758 Sep 19 10:44:31.574466 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 552/1085] 10.222.0.42 () {58 vars in 1155 bytes} [Mon Sep 19 10:44:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:46:40.525895 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82442b03-6b16-44b7-a113-dca8fd7410d5] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 19 10:46:40.527666 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:46:40.527812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 19 10:46:40.528993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:46:40.529210 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 19 10:46:40.530164 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:46:40.530458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 19 10:46:40.730859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-49252af2-7066-4b6f-aaaf-deb51fc98351 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Action: 'create', calling method: .version_select at 0x7fb9432ff040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1933920371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWr47YUcT9v/TlGjb2WCXqwpb1AYLWhdbZpk26Ovcguy0MgAAJMqSzO7HUasDwC1p9qnY2iKCsY5zPLpjrTlN8nqrghIJ7/lnfV8dExGxq1v2hxoEjokPRPS3FNXWELEw=="}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:46:40.745981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-49252af2-7066-4b6f-aaaf-deb51fc98351 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Getting quotas for project 311e428360814eee8331ecb4e8480db2. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:46:40.749875 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-49252af2-7066-4b6f-aaaf-deb51fc98351 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Getting quotas for user 87314ad8a589480286d768fde7cb4068 and project 311e428360814eee8331ecb4e8480db2. Resources: {'key_pairs'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:46:40.817018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-49252af2-7066-4b6f-aaaf-deb51fc98351 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.293574 Sep 19 10:46:40.817859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 534/1086] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:46:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:46:59.887896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:46:59.892001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:46:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 19 10:46:59.899062 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-999436339", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1933920371", "security_groups": [{"name": "tempest-secgroup-smoke-1354775248"}], "networks": [{"uuid": "40d3332b-95c0-422d-9a44-7cded6570980"}], "block_device_mapping_v2": [{"uuid": "a0099f75-0070-4113-a83b-5ddb52e6d896", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:47:00.116397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] validate_networks() for [('40d3332b-95c0-422d-9a44-7cded6570980', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:47:00.586365 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:47:00.586812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:47:00.587280 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:47:00.587712 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:47:00.588148 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:47:00.597552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:00.598021 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:00.598450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:00.599201 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:00.599647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:00.600065 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:00.616053 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Getting quotas for project 311e428360814eee8331ecb4e8480db2. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:47:00.619970 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Getting quotas for user 87314ad8a589480286d768fde7cb4068 and project 311e428360814eee8331ecb4e8480db2. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:47:00.675318 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:47:00.677520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0099f75-0070-4113-a83b-5ddb52e6d896',volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:47:00.896246 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37700. Sep 19 10:47:01.042025 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5184e62b-cd84-474b-bb3c-0e81ae3646dc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.155792 Sep 19 10:47:01.042679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 553/1087] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:46:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:47:01.052708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=4 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:47:01.053505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:47:01.059752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f68c3bcf-1281-4400-9d58-daf3fce041b2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:01.060631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f68c3bcf-1281-4400-9d58-daf3fce041b2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:01.071030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] [82442b03-6b16-44b7-a113-dca8fd7410d5] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37704. Sep 19 10:47:01.173783 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f68c3bcf-1281-4400-9d58-daf3fce041b2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:01.180637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f68c3bcf-1281-4400-9d58-daf3fce041b2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1088 microversion: 2.1 time: 0.130665 Sep 19 10:47:01.181344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 535/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:01 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1088 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:02.203363 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:02.203977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:02.211336 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:02.211828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:02.212266 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:02.212963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:02.213448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:02.213884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:02.274695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:02.282861 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1dd697ff-2c74-4a35-beff-7b0854deb10e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1138 microversion: 2.1 time: 0.083488 Sep 19 10:47:02.283435 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 554/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:02 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:03.306354 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:03.306991 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:03.315205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:03.315679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:03.316118 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:03.316820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:03.317301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:03.317724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:03.391767 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:03.399785 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3461a22e-a982-48bc-927a-e2af0437b89a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1194 microversion: 2.1 time: 0.097351 Sep 19 10:47:03.400590 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 536/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:03 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:04.422478 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:04.423090 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:04.434785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:04.434785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:04.434785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:04.434785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:04.435557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:04.435557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:04.571409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:04.578532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-e3a79325-dccf-4ec2-ae97-22d7da7383e9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1272 microversion: 2.1 time: 0.159374 Sep 19 10:47:04.579185 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 555/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:04 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:05.266103 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:47:05.275567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:05.276041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:05.276471 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:05.286959 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] Creating event network-changed:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:47:05.292784 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-ae0adfb8-f383-47a5-b182-97390dfec3c4 req-506baefd-7070-4080-bb31-c55f9ff10c8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097580 Sep 19 10:47:05.293499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 537/1092] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:47:05.601572 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:05.602285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:05.609459 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:05.609936 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:05.610364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:05.611049 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:05.611494 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:05.611911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:05.744701 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:05.752951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-21633230-2e7b-495b-a9fe-403356d6ef5b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.155427 Sep 19 10:47:05.753557 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 556/1093] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:05 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:06.777553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:06.778278 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:06.784905 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:06.785425 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:06.785898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:06.786641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:06.787107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:06.787536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:06.923863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:06.931432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1f0f1e42-61df-4fc0-b222-827e4911bd4c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.158883 Sep 19 10:47:06.932018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 538/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:06 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:07.955001 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:07.955615 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:07.961989 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:07.962475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:07.962919 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:07.963613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:07.964068 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:07.964497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:08.093515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:08.101215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ed7f3498-d477-4f40-8959-736557eb4ee7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.150772 Sep 19 10:47:08.106235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 557/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:07 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:09.124328 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:09.124852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:09.132029 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:09.132516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:09.132952 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:09.133669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:09.134124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:09.134549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:09.262570 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:09.270859 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-f1a60f8e-0b9e-4297-a906-51dc1e71a0cc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.150515 Sep 19 10:47:09.271423 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 539/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:09 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:10.298523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:10.299158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:10.306679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:10.310541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:10.310541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:10.310541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:10.310541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:10.310870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:10.443367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:10.450978 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c6e17bc3-3f86-4f06-9c5d-50260ffb1faa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.161022 Sep 19 10:47:10.451548 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 558/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:10 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:47:11.473639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:11.474252 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:11.476951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:47:11.481720 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:11.482266 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:11.482705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:11.483401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:11.483858 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:11.484287 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:11.618081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:11.626234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-287c6325-78e9-4593-bfc3-5caa49164a29 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.156462 Sep 19 10:47:11.626796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 540/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:11 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:12.649634 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:12.650238 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:12.652060 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:47:12.652721 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=6 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:47:12.658539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:12.659012 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:12.659440 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:12.660120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:12.660565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:12.660980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:12.794197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:12.801945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-384f81b9-a16c-4b03-9c9f-3333fd54e12d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.156583 Sep 19 10:47:12.802718 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 559/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:12 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:13.825091 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:13.837080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:13.837080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:13.837080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:13.837080 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:13.838023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:13.838023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:13.838023 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:13.967231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:13.975847 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ff065d2c-a952-4154-b2a7-4024fab39313 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.154678 Sep 19 10:47:13.976444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 541/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:13 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:14.999393 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:14.999933 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:15.007296 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:15.007966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:15.008407 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:15.009134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:15.009852 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:15.012610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:15.143754 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:15.151770 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-448e5b93-7afd-4803-9c19-67eb2a07c98c tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.156459 Sep 19 10:47:15.152343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 560/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:14 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:16.032839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "name": "network-vif-plugged", "status": "completed", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:47:16.042795 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:16.043285 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:16.043718 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:16.054399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] Creating event network-vif-plugged:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:47:16.059688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-1afd57d2-8c7e-462a-b558-559350a7d583 req-b26b2989-0d45-4a06-be22-0a2642901934 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030537 Sep 19 10:47:16.060277 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 542/1102] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:47:16.174797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:16.175424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:16.181792 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:16.182274 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:16.182716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:16.183409 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:16.183863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:16.184293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:16.315800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:16.323554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-531a8b8d-89f6-4471-8489-02b1e0fc16ed tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.153320 Sep 19 10:47:16.324134 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 561/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:16 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:17.348534 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:17.349303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:17.355478 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:17.355964 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:17.356404 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:17.357173 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:17.357631 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:17.358057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:17.488747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:17.496490 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b77e6ee6-8024-420d-9f3c-ff40d8e65769 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1260 microversion: 2.1 time: 0.153341 Sep 19 10:47:17.497076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 543/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:17 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:18.518669 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:18.519283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:18.525987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:18.526473 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:18.526934 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:18.527626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:18.528086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:18.528515 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:18.657829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:18.665600 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7628d77b-49ac-4f55-a231-25bda7e17184 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1444 microversion: 2.1 time: 0.150847 Sep 19 10:47:18.666194 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 562/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:18 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:18.688879 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:47:18.689522 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:47:18.695928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:18.696435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:18.696899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:18.697630 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:18.698090 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:18.698546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:18.826226 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:47:18.833991 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9f6c3bb1-b5f5-406f-80b5-7844062c3922 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1444 microversion: 2.1 time: 0.149612 Sep 19 10:47:18.834560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 544/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:47:18 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:47:20.856650 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:47:20.867100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:47:20.872523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:47:20.872523 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:47:20.879719 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] Creating event network-changed:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:47:20.885675 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-a45a116e-4e15-4a64-83ac-78d167184b45 req-9446f84c-f431-461d-9ed4-9a8c56d60337 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Sep 19 10:47:20.886262 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 563/1107] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:49:18.021855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=22 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:18.022623 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=46 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:18.027886 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:49:18.028441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:18.034500 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:18.035339 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:18.035735 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:18.036454 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:18.036899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:18.037344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:18.062372 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.objects.instance [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lazy-loading 'flavor' on Instance uuid acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc {{(pid=127497) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:49:18.371710 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-db6a5b91-d309-488e-a3b3-b87c26ba11fc tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "POST /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc/action" status: 202 len: 0 microversion: 2.1 time: 0.351542 Sep 19 10:49:18.372306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 545/1108] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:49:18 2022] POST /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 10:49:18.378880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 19 10:49:18.379632 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:18.380369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=58 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:18.385801 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:18.386490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:18.392729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:18.393264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:18.393730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:18.394425 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:18.394872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:18.395315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:18.538064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:18.546172 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c9d1536e-4b23-4f98-8318-3f63c99b5c8d tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.169233 Sep 19 10:49:18.546750 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 564/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:18 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:19.571057 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:19.571761 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:19.578355 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:19.578838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:19.579273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:19.579958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:19.580409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:19.580832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:19.711169 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:19.718881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-31dc51af-30ab-4a1c-a7a2-404d0d930f81 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.152097 Sep 19 10:49:19.719447 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 546/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:19 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:20.742491 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:20.743100 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:20.751621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:20.752102 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:20.752536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:20.753935 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:20.754392 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:20.754817 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:20.760631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37804. Sep 19 10:49:20.884455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:20.892168 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-20bd722a-52ec-405c-9093-97638cd7e566 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.153632 Sep 19 10:49:20.892735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 565/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:20 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:21.916017 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:21.916628 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:21.923022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:21.923499 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:21.923922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:21.924601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:21.925657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:21.926076 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:22.057289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:22.064867 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-938cf647-0e9e-403e-bc1e-3e1d1240185b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.152744 Sep 19 10:49:22.065469 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 547/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:21 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:49:23.089503 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:23.090110 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:23.096422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:23.096900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:23.097390 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:23.098072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:23.098561 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:23.098979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:23.239998 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:23.247717 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-af9e964f-e4a2-4ac5-9f6a-cb1b5d4dfd10 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.162427 Sep 19 10:49:23.248286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 566/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:23 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:24.272413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:24.273018 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:24.279733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:24.280222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:24.280661 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:24.281387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:24.281846 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:24.282272 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:24.410312 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:24.417984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-6b5036a2-0aaa-402e-a2f1-86e2167b045a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.150095 Sep 19 10:49:24.418555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 548/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:24 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:25.440866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:25.441568 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:25.447948 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:25.448427 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:25.448877 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:25.449579 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:25.450033 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:25.450457 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:25.579536 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:25.587384 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0145be04-5bb3-4ea4-ba32-9744fca045ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.150336 Sep 19 10:49:25.587956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 567/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:25 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:26.610857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:26.611462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:26.618457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:26.618932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:26.619361 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:26.620053 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:26.620503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:26.620988 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:26.752043 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:26.760390 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-46a7b056-ee6f-4ca2-a2a6-3c93f4c740b3 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.153486 Sep 19 10:49:26.760970 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 549/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:26 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:27.783305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:27.783953 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:27.790986 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:27.791475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:27.791911 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:27.792606 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:27.793086 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:27.793514 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:27.923878 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:27.931622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8d0fe550-df1e-4a2f-8dad-33828d5bbac9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.152227 Sep 19 10:49:27.932196 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 568/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:27 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:28.955451 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:28.956059 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:28.963041 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:28.963518 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:28.963941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:28.964624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:28.965094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:28.965505 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:29.178919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:29.187320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-69725b00-846a-4a16-81e5-9ac0ac5165dd tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.235735 Sep 19 10:49:29.187928 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 550/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:28 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:30.210213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:30.210829 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:30.217943 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:30.218462 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:30.218901 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:30.219592 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:30.220048 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:30.220476 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:30.347226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:30.354846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1de515e4-79c0-4227-9cb1-d1e3fcfec762 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.148508 Sep 19 10:49:30.355424 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 569/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:30 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:31.378049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:31.378619 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:31.384971 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:31.385522 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:31.386651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:31.387387 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:31.387831 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:31.388255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:31.529521 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:31.537326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d985213e-c3de-4adf-a96e-54561d191418 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.163199 Sep 19 10:49:31.547014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 551/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:31 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:32.561677 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:32.562285 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:32.568612 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:32.569114 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:32.569553 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:32.570241 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:32.570690 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:32.571117 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:32.697932 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:32.705741 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-015a7f96-1906-4e1b-9010-f5e66abe32da tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1570 microversion: 2.1 time: 0.148646 Sep 19 10:49:32.706271 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 570/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:32 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:32.728257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:49:32.728855 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:32.735466 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:32.735953 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:32.736386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:32.737105 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:32.737537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:32.737955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:32.825687 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127497) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 10:49:33.226530 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1f367621-a1a5-473e-864d-3d56acb9ac7a tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "POST /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc/action" status: 202 len: 0 microversion: 2.1 time: 0.502016 Sep 19 10:49:33.227135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 552/1122] 10.222.0.42 () {60 vars in 1278 bytes} [Mon Sep 19 10:49:32 2022] POST /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:49:33.235480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:33.236193 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:33.244311 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:33.244492 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:33.246545 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:33.250278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:33.250278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:33.250278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:33.387369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:33.395364 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-5524e8ca-cdd5-466b-bce6-cc4cfef4caf1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1518 microversion: 2.1 time: 0.163990 Sep 19 10:49:33.395944 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 571/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:33 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:34.420022 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:34.420736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:34.427269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:34.446054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:34.446054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:34.446054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:34.446054 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:34.447388 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:34.550453 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "name": "network-vif-unplugged", "status": "completed", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:49:34.561074 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:34.561552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:34.561987 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:34.573275 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.compute.server_external_events [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] Unable to find a host for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc. Dropping event network-vif-unplugged {{(pid=127496) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 19 10:49:34.574211 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-039f4e95-6778-47fa-9ed7-0205c1666750 req-8fa44df7-92c3-477c-814f-7d44a18810b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.094006 Sep 19 10:49:34.574802 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 572/1124] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 19 10:49:34.582245 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:34.589889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-699707a7-5f83-44b9-b1a3-7d2e395ac5df tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1520 microversion: 2.1 time: 0.174446 Sep 19 10:49:34.590445 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 553/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:34 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:35.613270 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:35.613870 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:35.620439 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:35.620956 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:35.621442 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:35.622179 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:35.622627 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:35.623063 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:35.754371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:35.762519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b2807130-0e17-4b1c-82d7-74ce734987b4 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1520 microversion: 2.1 time: 0.153151 Sep 19 10:49:35.763272 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 573/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:35 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:36.787832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:36.788444 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:36.794915 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:36.795397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:36.795828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:36.796515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:36.796965 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:36.797412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:36.931172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:36.938951 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c093d220-2ac9-448e-aeb3-bb2476bbaf42 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.155083 Sep 19 10:49:36.939540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 554/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:36 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:37.962682 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:37.963305 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:37.970362 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:37.970835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:37.971264 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:37.971942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:37.972416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:37.972862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:38.103489 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:38.112011 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7426e3dd-daf4-47ab-876d-f0ed7b744bb9 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.153318 Sep 19 10:49:38.112584 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 574/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:37 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:39.135671 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:39.136289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:39.143386 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:39.143870 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:39.144304 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:39.144996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:39.145485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:39.145914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:39.273818 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:39.282085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-58e7afbc-b740-48d7-873e-6b584ecd82b7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.150309 Sep 19 10:49:39.282652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 555/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:39 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:40.305367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:40.305963 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:40.313077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:40.313587 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:40.314013 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:40.314751 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:40.315200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:40.315620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:40.443783 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:40.451497 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-d6bf25af-2e52-47ec-8d62-3b34e77b229b tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.150105 Sep 19 10:49:40.452069 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 575/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:40 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:41.475638 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:41.476250 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:41.482654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:41.483128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:41.483562 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:41.484251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:41.484706 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:41.485159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:41.615968 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:41.623729 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-8edaa199-d2a6-4756-ae9b-811c0a246091 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.151923 Sep 19 10:49:41.624326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 556/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:41 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:42.647683 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:42.648287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:42.654904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:42.655386 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:42.655823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:42.656520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:42.656972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:42.657422 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:42.789974 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:42.798163 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f47c062f-220e-44ab-830b-8018504fcf82 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.153915 Sep 19 10:49:42.798736 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 576/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:42 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:43.822123 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:43.822650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:43.829837 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:43.830326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:43.830768 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:43.831474 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:43.831932 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:43.832390 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:43.964801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:43.972541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7940c856-71b3-452a-bb94-88016d16730f tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.154354 Sep 19 10:49:43.973128 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 557/1133] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:43 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:44.997300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:44.997916 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:45.004605 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:45.005175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:45.005623 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:45.006317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:45.006784 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:45.007208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:45.136389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:45.144571 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a6333113-e7d5-43b2-9ab4-7486ee64edfa tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.151237 Sep 19 10:49:45.145158 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 577/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:44 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:46.167741 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:46.168357 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:46.175358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:46.175863 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:46.176301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:46.176994 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:46.177482 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:46.177912 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:46.195244 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:46.309825 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:46.317604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d728b5f7-70b5-451c-9e2f-806e8e12d3ab tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.153756 Sep 19 10:49:46.318172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 558/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:46 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:47.340631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:47.341195 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:47.347570 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:47.348049 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:47.348484 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:47.349204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:47.349658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:47.350080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:47.482702 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:47.490982 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-11daf15a-3ac4-4b92-b48a-7df81607a432 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.154380 Sep 19 10:49:47.491554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 578/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:47 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:48.514644 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:48.515273 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:48.518430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:49:48.523223 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:48.523966 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:48.524432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:48.525193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:48.525667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:48.526094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:48.585245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "name": "network-vif-plugged", "status": "completed", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:49:48.595828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:48.596659 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:48.597137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:48.609506 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] Creating event network-vif-plugged:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:49:48.615104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-64931c98-8194-4d4a-8ce4-7c6dcd041b52 req-c3b88016-0193-4066-a90d-d832d2d8c70f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033670 Sep 19 10:49:48.615904 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 579/1137] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:49:48.661344 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:48.670866 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c8ad9e93-7405-4ad8-b0a6-e3eefaa18ef1 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.160039 Sep 19 10:49:48.675316 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 559/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:48 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:49.696144 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:49.696843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:49.703027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:49.703501 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:49.703931 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:49.704619 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:49.705087 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:49.705524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:49.832789 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:49.840520 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-6dfb0e76-ffdf-49ad-a604-427699d8ed68 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1576 microversion: 2.1 time: 0.149051 Sep 19 10:49:49.841111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 580/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:49 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:49:50.865321 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:49:50.865927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:49:50.872368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:50.872839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:50.873318 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:50.874007 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:49:50.874450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:49:50.874904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:49:51.003909 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:49:51.011615 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-7bf94444-aac9-4b3c-a0c7-6ed488c0802e tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1563 microversion: 2.1 time: 0.150428 Sep 19 10:49:51.012186 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 560/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:49:50 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:51:10.610385 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=34 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:10.611130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=94 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:10.612645 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:51:10.612805 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:51:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc (ip 10.222.0.42) !!! Sep 19 10:51:10.613791 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:51:10.613915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:51:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc (ip 10.222.0.42) !!! Sep 19 10:51:10.615579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:10.617408 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=14 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:10.623367 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:10.623519 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:51:10.623614 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:10.623709 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:51:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 19 10:51:10.626200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:51:10.630695 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:10.631179 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:10.631609 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:10.632300 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:10.632761 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:10.633230 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:10.640801 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:10.641485 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:10.642547 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:10.658156 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] Creating event network-changed:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:51:10.660760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:51:10.664024 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-278e67c8-f258-4527-8a8f-30630cbf634a req-ceedf860-619a-4cb6-b2bb-258fde0e9a54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051200 Sep 19 10:51:10.664914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 561/1141] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:51:10.920018 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fa4c473d-b9ac-4bd6-8a36-eda3f900c551 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "DELETE /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 204 len: 0 microversion: 2.1 time: 0.311275 Sep 19 10:51:10.924024 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 581/1142] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:51:10 2022] DELETE /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:51:10.930377 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:10.935653 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:10.937913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:10.938406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:10.938849 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:10.939564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:10.940025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:10.940481 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:11.223412 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:51:11.231157 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-192be5b9-10e0-4bbc-95ea-99ebe5c21062 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.305850 Sep 19 10:51:11.231744 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 562/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:51:10 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:51:12.256487 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:12.257220 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:12.264316 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:12.264793 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:12.265258 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:12.265946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:12.266397 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:12.266823 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:12.401626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:51:12.409412 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c1bde3b2-bb2c-4684-b2da-cc42d14161ee tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1569 microversion: 2.1 time: 0.157132 Sep 19 10:51:12.409983 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 582/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:51:12 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:51:13.432458 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:13.433107 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:13.439596 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:13.440071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:13.440503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:13.441227 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:13.441688 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:13.442114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:13.528723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:51:13.536592 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-90701b1c-d5c4-487c-bf4b-4ef17b7122e8 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1382 microversion: 2.1 time: 0.107973 Sep 19 10:51:13.550038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 563/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:51:13 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1382 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:51:13.564347 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc", "name": "network-vif-deleted", "tag": "07066654-41ed-41e9-ba96-db1c6532117f"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:51:13.577118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:13.577118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:13.577118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:13.586111 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] Creating event network-vif-deleted:07066654-41ed-41e9-ba96-db1c6532117f for instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc on hv-cinder-85827 Sep 19 10:51:13.591245 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-f43479a0-adfb-4c91-bcc9-7f38ca7a87f7 req-b5cbbeb0-efbb-4837-8d87-c9b0681afd38 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 Sep 19 10:51:13.591905 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 583/1146] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:51:14.560303 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:14.560919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:14.567301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:14.568000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:14.568205 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:14.568898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:14.569382 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:14.569815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:14.633300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87314ad8a589480286d768fde7cb4068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311e428360814eee8331ecb4e8480db2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:51:14.642651 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-be1a6c2c-e242-436a-9bcc-2fd254698f41 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 200 len: 1219 microversion: 2.1 time: 0.086224 Sep 19 10:51:14.643230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 564/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:51:14 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:51:15.668072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:15.668833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] [instance: acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:51:15.675105 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:15.675628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:15.676067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:15.676757 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:15.677252 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:15.677684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:15.690735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] HTTP exception thrown: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Request method failure captured: Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc HTTP/1.1 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEiK3K76m8d5ATCN4T1zlSwNuSmMlsWcJlJZKPICRYvFVXclNVix7GwG45UUFLxpsKbuswpCS1sVmlwROu0hUY7eBy7Np031dBoXyrowIbI48tdgLXeIwBAWnlvDRbVy5isI5n3NCNXAzDo-pPBjpJTFg8og63GJjz6w25MRFrUWKQQ Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 311e428360814eee8331ecb4e8480db2 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-TestShelveInstance-386674525 Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:51:15.692329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/311e428360814eee8331ecb4e8480db2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/311e428360814eee8331ecb4e8480db2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_311e428360814eee8331ecb4e8480db2", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/311e428360814eee8331ecb4e8480db2"}]}] Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-TestShelveInstance-386674525 Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 311e428360814eee8331ecb4e8480db2 Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-TestShelveInstance-386674525 Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-TestShelveInstance-386674525-project Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 87314ad8a589480286d768fde7cb4068 Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-TestShelveInstance-386674525-project Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. Sep 19 10:51:15.694197 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc'} Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:51:15.695324 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. Sep 19 10:51:15.697007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:51:15.698517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Returning 404 to user: Instance acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:51:15.698517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-acd0a1bd-738e-4152-a44c-5524b38db7e2 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc" status: 404 len: 111 microversion: 2.1 time: 0.030638 Sep 19 10:51:15.698517 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 584/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:51:15 2022] GET /compute/v2.1/servers/acf7fa4e-693b-4e9a-80e8-ac8f40dd44bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:51:15.922901 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9a1f392c-626f-419d-9d3b-e43d67be59e7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] Calling method '.version_select at 0x7fb9432ffdc0>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:51:16.022759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9a1f392c-626f-419d-9d3b-e43d67be59e7 tempest-TestShelveInstance-386674525 tempest-TestShelveInstance-386674525-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1933920371" status: 202 len: 0 microversion: 2.1 time: 0.103728 Sep 19 10:51:16.023650 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 565/1149] 10.222.0.42 () {58 vars in 1254 bytes} [Mon Sep 19 10:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1933920371 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 10:51:37.420282 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:37.421735 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:37.624723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b6da843a-52af-470c-a540-802f1c645343 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Action: 'create', calling method: .version_select at 0x7fb9430f2670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-309489895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAncb7Ygij0Rm2JqiRmOjaqAsrdOyaHxFpey/cID6Pdtxu+S6pUUUIHtf7Vod/pYHofeX/Y/o3RHxmaidbPip36FyKeyWcsRWAEAgqjD+6bTPc2WrQ7hWILU4Y6ZiloU+g=="}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:51:37.641016 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-b6da843a-52af-470c-a540-802f1c645343 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:51:37.644843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-b6da843a-52af-470c-a540-802f1c645343 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for user 78b9e41066d04492bed776a5c013346f and project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'key_pairs'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:51:37.743629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b6da843a-52af-470c-a540-802f1c645343 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.327831 Sep 19 10:51:37.743629 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 585/1150] 10.222.0.42 () {60 vars in 1159 bytes} [Mon Sep 19 10:51:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:51:58.089877 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1684780785", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309489895", "security_groups": [{"name": "tempest-secgroup-smoke-1404492929"}], "block_device_mapping_v2": [{"uuid": "49a83a86-5313-47b4-a701-4afd86a66706", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a49e492-1f1f-4b1e-95df-12a18170ee5a"}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:51:58.102898 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=20 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:58.103550 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:51:58.206393 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] validate_networks() for [('5a49e492-1f1f-4b1e-95df-12a18170ee5a', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:51:58.581987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:51:58.582406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:51:58.582871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:51:58.583270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:51:58.583672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:51:58.592198 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:58.592667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:58.593121 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:58.593833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:51:58.594281 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:51:58.594695 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:51:58.610538 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:51:58.614307 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for user 78b9e41066d04492bed776a5c013346f and project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:51:58.669654 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:51:58.671745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49a83a86-5313-47b4-a701-4afd86a66706',volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:51:59.117237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR oslo.messaging._drivers.impl_rabbit [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [cb2175d2-3a0c-4097-8bff-bdeecc35b2fa] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 10:52:00.124295 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [cb2175d2-3a0c-4097-8bff-bdeecc35b2fa] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38178. Sep 19 10:52:00.128637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-800a528f-7a9f-442a-8f06-99e412c19575 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.043565 Sep 19 10:52:00.129320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 566/1151] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:51:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:52:00.137729 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=4 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:52:00.138483 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:52:00.142314 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fe7ba9c8-d87d-4469-bd82-04f7e7472792 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:00.142927 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fe7ba9c8-d87d-4469-bd82-04f7e7472792 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:00.301562 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fe7ba9c8-d87d-4469-bd82-04f7e7472792 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:00.308628 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fe7ba9c8-d87d-4469-bd82-04f7e7472792 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1094 microversion: 2.1 time: 0.172229 Sep 19 10:52:00.309301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 586/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:00 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1094 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:01.332448 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:01.332984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:01.339670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:01.340143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:01.340571 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:01.341293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:01.341751 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:01.342167 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:01.458172 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:01.466600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-db9dcc45-3aa6-4766-9f9b-b8986d5f393c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1144 microversion: 2.1 time: 0.138683 Sep 19 10:52:01.467154 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 567/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:01 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1144 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:02.489531 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:02.490283 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:02.496866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:02.497388 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:02.497833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:02.498539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:02.498996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:02.499429 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:02.808373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:02.819542 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2ba80ea4-de3b-4282-a89d-0b39f3615f63 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1200 microversion: 2.1 time: 0.333971 Sep 19 10:52:02.834343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 587/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:02 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1200 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:03.842084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:03.843668 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:03.849329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:03.849820 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:03.850255 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:03.850957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:03.851441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:03.851844 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:04.059035 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:04.066923 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-89f91e00-e421-4637-a03e-7c901f630361 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1278 microversion: 2.1 time: 0.228731 Sep 19 10:52:04.067821 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 568/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:03 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1278 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:04.157329 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4ae582-5ab5-4a47-8929-5bbae1ac2fba", "tag": "a67e9671-8d1d-4d59-8813-23658919e0c8"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:52:04.167469 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:04.167946 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:04.168383 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:04.179108 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] Creating event network-changed:a67e9671-8d1d-4d59-8813-23658919e0c8 for instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba on hv-cinder-85827 Sep 19 10:52:04.184674 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-90fb587e-83c1-4bcb-9555-bf0c1945424d req-65ecba28-6633-4721-b172-2b23b9907b02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031042 Sep 19 10:52:04.185955 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 588/1156] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:52:05.091724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:05.092317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:05.099112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:05.099599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:05.100030 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:05.100737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:05.101251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:05.101679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:05.357317 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:05.364967 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-de037865-40ac-40e6-95c0-4938e591ee73 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.277849 Sep 19 10:52:05.365591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 569/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:05 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:06.389410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:06.390149 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:06.396252 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:06.396738 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:06.397212 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:06.398176 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:06.398633 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:06.399064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:06.530233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:06.537906 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bb2ea24f-c277-41f2-af40-21aad23cd256 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.153665 Sep 19 10:52:06.538694 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 589/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:06 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:07.560714 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:07.561345 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:07.567667 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:07.568151 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:07.568583 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:07.569314 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:07.569852 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:07.570192 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:07.704120 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:07.711624 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0f2edbb7-25aa-4398-8d30-cbb67a985486 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.154898 Sep 19 10:52:07.712182 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 570/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:07 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:08.735038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:08.735900 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:08.742287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:08.742766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:08.743203 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:08.744582 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:08.745031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:08.745480 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:08.886924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:08.894644 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-660e5ceb-ab59-4582-857d-ac876cfad53d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.163456 Sep 19 10:52:08.895213 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 590/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:08 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:09.917822 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:09.918435 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:09.920750 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:52:09.921431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:52:09.926176 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:09.926663 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:09.927094 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:09.927781 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:09.928230 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:09.928656 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:10.061804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:10.069501 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-4fbd7103-8d26-4093-955f-ed570bcd3056 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.156250 Sep 19 10:52:10.070063 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 571/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:09 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:11.091907 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:11.092519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:11.095030 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:52:11.099843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:11.100376 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:11.100807 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:11.101524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:11.101969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:11.102387 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:11.235236 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:11.242843 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-683fa88b-c6d8-4db3-84aa-d9e3c1e7d725 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.154940 Sep 19 10:52:11.243405 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 591/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:11 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:12.265777 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:12.266405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:12.273050 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:12.273564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:12.274005 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:12.274698 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:12.275159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:12.275586 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:12.404134 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:12.411803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-acf35be7-0920-4aac-a750-680e5fd3487c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.149889 Sep 19 10:52:12.415212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 572/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:12 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:13.434869 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:13.435625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:13.442047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:13.442534 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:13.442977 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:13.443670 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:13.444133 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:13.444559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:13.575846 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:13.583450 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0b87c3c3-73b0-4659-a2ba-ed7103fb0132 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.152604 Sep 19 10:52:13.584019 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 592/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:13 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:14.606755 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:14.607331 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:14.613758 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:14.614238 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:14.614672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:14.615356 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:14.615810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:14.616233 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:14.744868 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:14.752405 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-a3d7f3ce-9378-4b63-95fc-ffa10465ac65 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.150105 Sep 19 10:52:14.752974 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 573/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:14 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:15.289448 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4ae582-5ab5-4a47-8929-5bbae1ac2fba", "name": "network-vif-plugged", "status": "completed", "tag": "a67e9671-8d1d-4d59-8813-23658919e0c8"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:52:15.299075 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:15.301293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:15.301293 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:15.311291 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] Creating event network-vif-plugged:a67e9671-8d1d-4d59-8813-23658919e0c8 for instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba on hv-cinder-85827 Sep 19 10:52:15.316604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-f0f9272f-a147-4d77-a554-0ed038d11a26 req-1cd2c277-6e5a-4472-8181-a75e65a13c8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Sep 19 10:52:15.317224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 593/1166] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:52:15.775748 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:15.776368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:15.782723 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:15.783206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:15.783646 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:15.784342 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:15.784800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:15.785262 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:15.913708 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:15.924441 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-3f2c2eca-66d7-401c-84ee-2c93d65207fe tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.153362 Sep 19 10:52:15.925021 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 574/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:15 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:16.948351 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:16.949080 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:16.955455 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:16.955969 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:16.956521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:16.957301 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:16.957808 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:16.958312 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:17.095423 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:17.103593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-c8d7ea20-e5a1-4acc-a488-511a4ad73537 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1266 microversion: 2.1 time: 0.160013 Sep 19 10:52:17.107764 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 594/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:16 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:18.126461 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:18.127100 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:18.133413 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:18.133887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:18.134318 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:18.135025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:18.135472 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:18.135887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:18.270042 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:18.278757 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-9d3727ec-2617-45cb-88f8-bbba19e12da5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1452 microversion: 2.1 time: 0.156301 Sep 19 10:52:18.279329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 575/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:18 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:18.301177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:52:18.301800 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:52:18.308120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:18.308598 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:18.309034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:18.309742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:18.310200 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:18.310624 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:18.436646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:52:18.444215 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-a3dbcafe-237b-42a0-a8a0-45899b49768b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1452 microversion: 2.1 time: 0.146921 Sep 19 10:52:18.444781 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 595/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:52:18 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:52:20.389073 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4ae582-5ab5-4a47-8929-5bbae1ac2fba", "tag": "a67e9671-8d1d-4d59-8813-23658919e0c8"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:52:20.398857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:52:20.399812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:52:20.400427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:52:20.411155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] Creating event network-changed:a67e9671-8d1d-4d59-8813-23658919e0c8 for instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba on hv-cinder-85827 Sep 19 10:52:20.417174 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-a0d8e3ee-0ff8-4f64-ac87-4ddc298012de req-b83b3b9e-1d6f-432d-b382-96e95b618217 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092009 Sep 19 10:52:20.418115 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 576/1171] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:54:17.603447 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=22 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:17.604118 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=46 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:17.605868 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:54:17.606015 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba (ip 10.222.0.42) !!! Sep 19 10:54:17.607681 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:54:17.607825 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba (ip 10.222.0.42) !!! Sep 19 10:54:17.623443 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:17.623930 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:17.630104 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:17.630596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:17.631061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:17.631734 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:17.632177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:17.632595 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:17.660178 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:54:17.878945 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3030e119-2f1c-4986-b095-02a16a596955 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 204 len: 0 microversion: 2.1 time: 0.277274 Sep 19 10:54:17.879481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 596/1172] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:54:17 2022] DELETE /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:54:17.886722 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:17.887555 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=58 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:17.889046 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 10:54:17.889212 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:54:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba (ip 10.222.0.42) !!! Sep 19 10:54:17.894689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:17.895406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:17.905560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:17.906079 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:17.906524 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:17.907222 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:17.907679 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:17.908143 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:18.041326 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:18.048958 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d7b823ed-b106-4930-8e3e-1507082dd0c5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1577 microversion: 2.1 time: 0.165026 Sep 19 10:54:18.049546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 577/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:17 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:19.072331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:19.073034 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:19.080204 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:19.080621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:19.081081 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:19.081779 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:19.082231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:19.082653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:19.217350 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:19.226119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-40da0982-f5f6-4a51-8c2f-b0cab23ef1ab tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1577 microversion: 2.1 time: 0.158055 Sep 19 10:54:19.226685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 597/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:19 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:20.250124 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:20.250745 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:20.256993 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:20.257509 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:20.257957 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:20.258670 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:20.259125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:20.259553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:20.464136 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:20.471914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e4a22645-ba36-4e5f-8be3-a11ecd9607a7 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1577 microversion: 2.1 time: 0.225734 Sep 19 10:54:20.472489 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 578/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:20 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:21.042768 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4ae582-5ab5-4a47-8929-5bbae1ac2fba", "name": "network-vif-deleted", "tag": "a67e9671-8d1d-4d59-8813-23658919e0c8"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:54:21.063972 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:21.065214 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:21.066233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:21.085040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] Creating event network-vif-deleted:a67e9671-8d1d-4d59-8813-23658919e0c8 for instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba on hv-cinder-85827 Sep 19 10:54:21.090999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-13926d72-f843-471e-afc2-594e0991d342 req-3992c203-ab97-4a8a-a5b7-1e3a71c44aa9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176260 Sep 19 10:54:21.091866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 598/1176] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:54:21.496086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:21.496919 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:21.503526 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:21.504014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:21.504453 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:21.505183 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:21.505641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:21.506062 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:21.570503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:21.578350 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c9342dfd-006f-4239-abe3-4277f8853f4a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1225 microversion: 2.1 time: 0.086717 Sep 19 10:54:21.579918 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 579/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:21 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:22.602564 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:22.603267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:22.609990 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:22.612540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:22.612540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:22.612540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:22.612540 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:22.612942 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:22.644235 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:22.644749 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:22.667433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:22.667433 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lazy-loading 'fault' on Instance uuid df4ae582-5ab5-4a47-8929-5bbae1ac2fba {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:54:22.687510 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:22.694941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7252a290-06f0-43e8-9402-2088cd0d75e8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 200 len: 1184 microversion: 2.1 time: 0.097158 Sep 19 10:54:22.695516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 599/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:22 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 1184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:23.717887 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:23.718488 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:23.724904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:23.725419 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:23.725850 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:23.726540 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:23.726989 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:23.727407 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:23.741546 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] HTTP exception thrown: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Request method failure captured: Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba HTTP/1.1 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEmzYPjjo_RNu1p3221xbC3XVqM0r5TtidGBWParcajP8VPzghI3_uDEkV-QelWY2PTqW4gQjwivdPEs8uM2FfIgMoYmdcqJUfBzky6Yc0CjAZNkebOB9qLfTy3s1h8jrPU8YYLrbTPaao4ifHDDThZRGJP3XH2WU7_vA3IXh-ldrgA Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:54:23.743220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83720c34e40e4f2ba7f9fe719db3c259", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}] Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 78b9e41066d04492bed776a5c013346f Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:54:23.744981 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'df4ae582-5ab5-4a47-8929-5bbae1ac2fba'} Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:54:23.746832 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:54:23.748527 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:54:23.750095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Returning 404 to user: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:54:23.750095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-e0161a2f-6e58-4160-84c7-873c9847f798 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 404 len: 111 microversion: 2.1 time: 0.030661 Sep 19 10:54:23.750095 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 580/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:23 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:54:23.794078 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1293615433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309489895", "security_groups": [{"name": "tempest-secgroup-smoke-1404492929"}], "block_device_mapping_v2": [{"uuid": "49a83a86-5313-47b4-a701-4afd86a66706", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a49e492-1f1f-4b1e-95df-12a18170ee5a"}]}} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:54:23.907785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.network.neutron [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] validate_networks() for [('5a49e492-1f1f-4b1e-95df-12a18170ee5a', None, None, None, None, None)] {{(pid=127496) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:54:24.346857 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:54:24.347286 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image limits 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:54:24.347759 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:54:24.348191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image pref 0:0:0 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:54:24.348604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.virt.hardware [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:54:24.357715 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:24.358187 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:24.358620 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:24.359343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:24.359794 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:24.360217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:24.377224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:54:24.381130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.quota [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for user 78b9e41066d04492bed776a5c013346f and project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:54:24.436780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Going to run 1 instances... {{(pid=127496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:54:24.438918 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49a83a86-5313-47b4-a701-4afd86a66706',volume_size=None,volume_type=None)] {{(pid=127496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:54:24.808769 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1893e49e-f835-47bd-864a-fe9b9ec86e1b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.019241 Sep 19 10:54:24.813747 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 600/1180] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:54:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:54:24.820649 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-716d1c65-e463-4aa4-9e83-724f25dff138 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:24.821293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-716d1c65-e463-4aa4-9e83-724f25dff138 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:24.873160 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-716d1c65-e463-4aa4-9e83-724f25dff138 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:24.879827 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-716d1c65-e463-4aa4-9e83-724f25dff138 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1094 microversion: 2.1 time: 0.063037 Sep 19 10:54:24.880385 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 581/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:24 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:25.904175 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fbf10acd-d5f6-439b-bddd-9d3f36dbb31d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:25.904797 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fbf10acd-d5f6-439b-bddd-9d3f36dbb31d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:25.957565 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fbf10acd-d5f6-439b-bddd-9d3f36dbb31d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:25.964981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fbf10acd-d5f6-439b-bddd-9d3f36dbb31d tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1094 microversion: 2.1 time: 0.065836 Sep 19 10:54:25.965566 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 601/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:25 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:26.987642 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-28345915-3b16-4f62-b89e-3afd213b8de3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:26.988289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-28345915-3b16-4f62-b89e-3afd213b8de3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:27.043815 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-28345915-3b16-4f62-b89e-3afd213b8de3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:27.050682 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-28345915-3b16-4f62-b89e-3afd213b8de3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1094 microversion: 2.1 time: 0.066919 Sep 19 10:54:27.051244 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 582/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:26 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:28.073924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7dd2ce62-d6a1-4eb0-9975-181f279bf724 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:28.074636 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7dd2ce62-d6a1-4eb0-9975-181f279bf724 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:28.130622 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7dd2ce62-d6a1-4eb0-9975-181f279bf724 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:28.137380 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7dd2ce62-d6a1-4eb0-9975-181f279bf724 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1094 microversion: 2.1 time: 0.067962 Sep 19 10:54:28.137954 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 602/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:28 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:29.160127 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:29.160743 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:29.167197 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:29.167678 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:29.168112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:29.169409 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:29.169865 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:29.170294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:29.228759 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:29.237470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-c19b4640-933a-40d6-983c-b1147bc9a88b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1144 microversion: 2.1 time: 0.081172 Sep 19 10:54:29.238112 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 583/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:29 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:30.259851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:30.260485 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:30.267141 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:30.267626 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:30.268060 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:30.268753 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:30.269229 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:30.269658 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:30.330410 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:30.338055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-90161b4c-b74b-47a7-840a-a5399e043c69 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1136 microversion: 2.1 time: 0.082075 Sep 19 10:54:30.338621 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 603/1186] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:30 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:31.362150 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:31.362810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:31.368805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:31.369310 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:31.369747 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:31.370433 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:31.370880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:31.371301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:31.443251 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:31.452017 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-983cab02-20c9-4bd7-b7a8-8bb3105e5596 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1210 microversion: 2.1 time: 0.094784 Sep 19 10:54:31.452589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 584/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:31 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:32.476208 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:32.476827 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:32.484343 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:32.484828 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:32.485299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:32.486007 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:32.486467 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:32.486894 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:32.631820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:32.640156 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9cc05413-6ead-498a-83c5-ab4089c033c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1278 microversion: 2.1 time: 0.167959 Sep 19 10:54:32.640745 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 604/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:32 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:33.134826 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7", "tag": "cf274c7b-27ae-46d6-b4dc-5abaf2eb041e"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:54:33.147171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:33.147647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:33.148104 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:33.160773 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] Creating event network-changed:cf274c7b-27ae-46d6-b4dc-5abaf2eb041e for instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 on hv-cinder-85827 Sep 19 10:54:33.165762 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-224ef7fa-78ea-4b49-a27f-2461e33eb353 req-8b13a85a-94f0-4b3b-b73e-394bd42a70aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034731 Sep 19 10:54:33.166369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 585/1189] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:54:33.663635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:33.664273 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:33.671303 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:33.671785 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:33.672231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:33.672924 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:33.673416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:33.673847 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:33.807239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:33.815092 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-05c11535-ebfc-4d1d-b34a-8ace3a5ca4f8 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.155322 Sep 19 10:54:33.815872 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 605/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:33 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:34.840081 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:34.840810 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:34.847639 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:34.848114 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:34.848549 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:34.849270 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:34.849736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:34.850131 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:34.982246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:34.989821 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-dd2d8706-dd26-4046-a15c-02a7b7a87c94 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.154518 Sep 19 10:54:34.990390 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 586/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:34 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:36.013137 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:36.013860 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:36.015820 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:36.021330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:36.026371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:36.026371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:36.026371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:36.026371 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:36.026780 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:36.152649 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:36.160926 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b65fc01e-fd7f-4d92-b812-19752734450b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.151967 Sep 19 10:54:36.161524 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 606/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:36 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:37.182567 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:37.183181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:37.186414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=4 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:37.191239 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:37.191776 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:37.198038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:37.198038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:37.198038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:37.198038 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:37.323340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:37.331066 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b42350b6-a6fd-4a12-b639-bff2b8a77674 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.152384 Sep 19 10:54:37.331635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 587/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:37 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:38.360554 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:38.361190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:38.363490 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=10 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:38.368130 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:38.368610 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:38.369087 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:38.376653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:38.376653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:38.376653 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:38.505190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:38.512960 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-7494d547-0a0a-4917-883b-c65d5872d191 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.156331 Sep 19 10:54:38.514059 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 607/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:38 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:39.537599 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:39.538246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:39.544737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:39.545790 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:39.546231 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:39.546926 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:39.547384 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:39.547812 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:39.683669 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:39.691828 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1e5727e6-f0fa-4afa-b070-17a469629863 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.158361 Sep 19 10:54:39.692396 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 588/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:39 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:40.715394 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:40.716038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:40.722997 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:40.723479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:40.723913 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:40.724603 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:40.725085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:40.725516 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:40.852880 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:40.860687 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-b542b60c-4839-4f06-940a-77cf3d0b68e3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.149337 Sep 19 10:54:40.861278 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 608/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:40 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:41.882589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:41.883220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:41.889672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:41.890149 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:41.890601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:41.891294 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:41.891742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:41.892163 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:42.021904 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:42.030000 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d874a9df-9f4a-4fc4-8dcd-09d27a946f53 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.151337 Sep 19 10:54:42.030564 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 589/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:41 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:43.053146 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:43.053710 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:43.060004 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:43.060481 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:43.060910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:43.061613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:43.062061 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:43.062479 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:43.191319 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:43.198867 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-fda9cb6e-87f7-4330-87ff-a49dfa91331e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.149782 Sep 19 10:54:43.199434 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 609/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:43 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:44.130676 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7", "name": "network-vif-plugged", "status": "completed", "tag": "cf274c7b-27ae-46d6-b4dc-5abaf2eb041e"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:54:44.140140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:44.140605 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:44.141027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:44.152199 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] Creating event network-vif-plugged:cf274c7b-27ae-46d6-b4dc-5abaf2eb041e for instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 on hv-cinder-85827 Sep 19 10:54:44.158122 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-2f7f86eb-f364-4b18-bcfa-5b6ce829f96c req-66e309f8-5d10-497d-b3aa-126983d1ef4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086723 Sep 19 10:54:44.158881 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 590/1199] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:54:44.221871 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:44.222475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:44.228782 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:44.229298 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:44.229771 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:44.230464 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:44.230910 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:44.231331 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:44.365847 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:44.373537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-28e276f5-dae9-40da-a491-35b0448aa849 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.155565 Sep 19 10:54:44.380760 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 610/1200] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:44 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:45.398364 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:45.399085 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:45.405845 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:45.406320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:45.406752 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:45.407432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:45.407880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:45.408300 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:45.538432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:45.546010 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0801c31f-82f3-4b2e-beaf-79bceed7e6f6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1266 microversion: 2.1 time: 0.152627 Sep 19 10:54:45.546573 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 591/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:45 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:46.569602 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:46.570206 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:46.577136 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:46.577625 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:46.578071 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:46.578767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:46.579233 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:46.579663 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:46.705559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:46.713191 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-2803edf1-022e-45d0-864d-5330aa22c102 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1452 microversion: 2.1 time: 0.147511 Sep 19 10:54:46.713766 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 611/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:46 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:46.735591 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:54:46.736206 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:54:46.742536 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:46.743016 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:46.743450 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:46.744140 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:46.744589 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:46.745014 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:46.873039 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:54:46.880724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-360da90c-3e97-4167-aa2a-3d22a5c6ad83 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1452 microversion: 2.1 time: 0.148968 Sep 19 10:54:46.881320 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 592/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:54:46 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:54:48.754077 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7", "tag": "cf274c7b-27ae-46d6-b4dc-5abaf2eb041e"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:54:48.759456 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:48.764560 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:54:48.765040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:54:48.765493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:54:48.768066 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:54:48.777631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] Creating event network-changed:cf274c7b-27ae-46d6-b4dc-5abaf2eb041e for instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 on hv-cinder-85827 Sep 19 10:54:48.783396 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-389365d7-cea2-48d9-bcc3-41b1cb3e168a req-e0a42c07-17f9-4fbc-9bbe-ed6b8b2fc520 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032967 Sep 19 10:54:48.784195 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 612/1204] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:56:36.985234 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=36 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:56:36.986052 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=72 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:56:36.986803 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:56:36.986948 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:56:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 19 10:56:36.991604 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-659223869", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-309489895", "security_groups": [{"name": "tempest-secgroup-smoke-1404492929"}], "block_device_mapping_v2": [{"uuid": "e9916465-05ed-4379-b095-919d0f9d05b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5a49e492-1f1f-4b1e-95df-12a18170ee5a"}]}} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:56:37.107467 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.network.neutron [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] validate_networks() for [('5a49e492-1f1f-4b1e-95df-12a18170ee5a', None, None, None, None, None)] {{(pid=127497) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 10:56:37.813914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 10:56:37.814360 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image limits 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 10:56:37.814861 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Flavor pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 10:56:37.815274 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Image pref 0:0:0 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 10:56:37.815800 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.virt.hardware [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127497) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 10:56:37.824988 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:37.825497 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:37.826652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:37.827528 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:37.827987 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:37.828414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:37.844610 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 10:56:37.848569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.quota [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Getting quotas for user 78b9e41066d04492bed776a5c013346f and project 83720c34e40e4f2ba7f9fe719db3c259. Resources: {'cores', 'instances', 'ram'} {{(pid=127497) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 10:56:37.905193 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Going to run 1 instances... {{(pid=127497) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 10:56:37.907306 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9916465-05ed-4379-b095-919d0f9d05b9',volume_size=None,volume_type=None)] {{(pid=127497) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 10:56:38.277165 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-b2961819-5478-47fe-a928-7a5bc02ef016 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.293663 Sep 19 10:56:38.277913 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 593/1205] 10.222.0.42 () {60 vars in 1147 bytes} [Mon Sep 19 10:56:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 10:56:38.287810 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 10:56:38.292925 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-8b1a2884-b261-4b61-884e-8d3244e04eb5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:38.293651 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-8b1a2884-b261-4b61-884e-8d3244e04eb5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:38.353578 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-8b1a2884-b261-4b61-884e-8d3244e04eb5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:38.361095 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-8b1a2884-b261-4b61-884e-8d3244e04eb5 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1093 microversion: 2.1 time: 0.075014 Sep 19 10:56:38.361684 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 613/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:38 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:39.384353 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:39.385003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:39.391137 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:39.391733 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:39.392181 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:39.392882 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:39.393373 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:39.393804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:39.454927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:39.462780 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-83ef609c-e082-4653-a923-a12a54707ac2 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1135 microversion: 2.1 time: 0.083015 Sep 19 10:56:39.463348 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 594/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:39 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:40.491528 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:40.492244 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:40.502836 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:40.503613 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:40.504067 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:40.504755 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:40.505239 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:40.505660 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:40.511539 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff469aba-ed50-4a92-9146-9cb8d8c2de7b] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38486. Sep 19 10:56:40.573884 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:40.584093 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4f283146-d1f8-408a-bfc3-41ec8e5860a6 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1209 microversion: 2.1 time: 0.096691 Sep 19 10:56:40.590668 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 614/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:40 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1209 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:41.607903 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:41.608537 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:41.615145 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:41.615434 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:41.615871 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:41.616568 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:41.617024 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:41.617470 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:41.839201 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:41.847370 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2c48c10a-32e4-4b5d-ad82-716d64d9801a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1277 microversion: 2.1 time: 0.243518 Sep 19 10:56:41.847933 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 595/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:41 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:42.103072 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f5039f-726c-4c4b-abce-0e52bcedde8c", "tag": "a135ff9a-d835-4ae7-aac4-370fd7ef3349"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:56:42.113045 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:42.113552 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:42.113980 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:42.125122 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] Creating event network-changed:a135ff9a-d835-4ae7-aac4-370fd7ef3349 for instance 00f5039f-726c-4c4b-abce-0e52bcedde8c on hv-cinder-85827 Sep 19 10:56:42.130085 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-2ef0f241-0637-4e4c-adc7-d14d0f587e8f req-700f46ea-2a80-4066-87b7-728797c6b28f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031544 Sep 19 10:56:42.134833 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 615/1210] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:56:42.870645 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:42.871200 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:42.877462 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:42.877944 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:42.878375 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:42.879064 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:42.879516 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:42.879941 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:43.032954 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:43.040541 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2252be36-35d5-4aa2-addf-19656e69e165 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.173854 Sep 19 10:56:43.041237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 596/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:42 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:44.063854 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:44.064569 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:44.071120 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:44.071604 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:44.072031 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:44.072708 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:44.073177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:44.073596 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:44.202521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:44.210160 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-896b84a0-fe64-4dba-938e-1583ea67d73b tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.150556 Sep 19 10:56:44.210728 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 616/1212] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:44 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:45.233401 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:45.234013 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:45.240430 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:45.240914 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:45.241376 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:45.242078 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:45.242525 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:45.242977 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:45.371731 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:45.379770 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-72eed64e-fc03-43e6-bbf4-65ad76732f37 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.150299 Sep 19 10:56:45.380340 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 597/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:45 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:46.403181 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:46.404452 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:46.410914 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:46.411403 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:46.411847 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:46.412541 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:46.412999 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:46.413458 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:46.544355 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:46.552064 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-f2418ee4-f3a9-4737-b52b-24385fe741dc tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.152767 Sep 19 10:56:46.552635 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 617/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:46 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:47.574476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:47.575086 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:47.581257 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:47.581739 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:47.582171 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:47.582854 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:47.583301 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:47.583721 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:47.714920 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:47.723125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-1ee18333-dfc9-43f6-bb6d-968e885a90c3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.152522 Sep 19 10:56:47.723689 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 598/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:47 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:48.746671 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:48.747938 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:48.750504 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell0:SELECT=2 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:56:48.755290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:48.755795 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:48.756232 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:48.756981 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:48.757463 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:48.757775 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f5039f-726c-4c4b-abce-0e52bcedde8c", "name": "network-vif-plugged", "status": "completed", "tag": "a135ff9a-d835-4ae7-aac4-370fd7ef3349"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:56:48.758299 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:48.764027 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=2 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:56:48.764686 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell0:SELECT=6 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:56:48.770601 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:48.771071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:48.771496 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:48.782545 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] Creating event network-vif-plugged:a135ff9a-d835-4ae7-aac4-370fd7ef3349 for instance 00f5039f-726c-4c4b-abce-0e52bcedde8c on hv-cinder-85827 Sep 19 10:56:48.788003 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-edc49671-6c91-4551-8f23-399af88e3fff req-508cd097-1021-4d68-9829-af63915895bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033971 Sep 19 10:56:48.788593 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 599/1216] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:56:48.894979 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:48.902917 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-0fc1f6a4-304a-4929-8d1e-5076a1d5b5b3 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.160221 Sep 19 10:56:48.903535 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 618/1217] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:48 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:49.927325 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:49.928034 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:49.935324 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:49.935804 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:49.936237 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:49.936922 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:49.937415 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:49.937839 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:50.068889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:50.077322 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ac95ebfc-69ff-4d41-9c19-2d9cc7f09564 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1265 microversion: 2.1 time: 0.155039 Sep 19 10:56:50.077829 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 600/1218] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:49 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:51.098856 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:51.099398 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:51.105851 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:51.106330 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:51.106767 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:51.107451 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:51.107899 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:51.108321 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:51.237863 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:51.245475 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9f4b643e-80a0-4b38-840d-5df212b6e40a tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1451 microversion: 2.1 time: 0.150498 Sep 19 10:56:51.246038 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 619/1219] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:51 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:51.267724 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:56:51.268336 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:56:51.275025 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:51.275494 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:51.275917 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:51.276594 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:51.277084 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:51.277498 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:51.410135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:56:51.417996 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-50a8bfa8-cf87-48cb-a27a-221109c468ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1451 microversion: 2.1 time: 0.154095 Sep 19 10:56:51.418563 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 601/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:56:51 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:56:53.341333 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f5039f-726c-4c4b-abce-0e52bcedde8c", "tag": "a135ff9a-d835-4ae7-aac4-370fd7ef3349"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:56:53.351493 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:56:53.352040 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:56:53.352590 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:56:53.364585 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] Creating event network-changed:a135ff9a-d835-4ae7-aac4-370fd7ef3349 for instance 00f5039f-726c-4c4b-abce-0e52bcedde8c on hv-cinder-85827 Sep 19 10:56:53.370256 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-65ed936b-a7d5-4d67-80d5-cfad6ab6b789 req-eb382903-f657-45f8-a604-d828fd6ebdd2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032065 Sep 19 10:56:53.370457 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 620/1221] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:58:22.436167 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_api:SELECT=19 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:58:22.436915 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG dbcounter [-] [127496] Writing DB stats nova_cell1:SELECT=35 {{(pid=127496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:58:22.437723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:58:22.437866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 19 10:58:22.439070 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:58:22.440207 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:58:22.440955 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG dbcounter [-] [127497] Writing DB stats nova_cell1:SELECT=46 {{(pid=127497) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 10:58:22.445329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 10:58:22.445329 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Mon Sep 19 10:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c (ip 10.222.0.42) !!! Sep 19 10:58:22.446569 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:22.446951 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Mon Sep 19 10:58:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 19 10:58:22.447088 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:22.453281 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f5039f-726c-4c4b-abce-0e52bcedde8c", "tag": "a135ff9a-d835-4ae7-aac4-370fd7ef3349"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:58:22.453641 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:22.454125 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:22.454553 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:22.455246 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:22.455700 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:22.456117 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:22.474798 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:22.475276 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:22.475723 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:22.484999 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Going to try to terminate instance {{(pid=127497) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:58:22.489217 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] Creating event network-changed:a135ff9a-d835-4ae7-aac4-370fd7ef3349 for instance 00f5039f-726c-4c4b-abce-0e52bcedde8c on hv-cinder-85827 Sep 19 10:58:22.494853 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-6230a954-e8b7-4f46-8e06-9d30db58b483 req-d9949479-4f51-4843-93cf-a15f18ec6519 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060758 Sep 19 10:58:22.497027 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 621/1222] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:58:22.848399 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-2224851c-479f-46e0-9e72-39d9d1a9403c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 204 len: 0 microversion: 2.1 time: 0.416390 Sep 19 10:58:22.849397 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 602/1223] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:58:22 2022] DELETE /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:58:22.858811 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:22.859666 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:22.866831 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:22.870055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:22.870055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:22.870055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:22.870055 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:22.870652 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:23.068947 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:23.077024 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-4abb7b2b-ebb7-45a1-98b9-4eac126f0594 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1576 microversion: 2.1 time: 0.222741 Sep 19 10:58:23.077322 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 622/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:22 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:24.100742 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:24.101395 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:24.107899 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:24.108369 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:24.108796 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:24.109503 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:24.109950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:24.110368 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:24.352677 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:24.360379 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-ae65837c-be5c-4c9f-a966-29c3e8f81740 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1576 microversion: 2.1 time: 0.264327 Sep 19 10:58:24.360947 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 603/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:24 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:25.352223 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f5039f-726c-4c4b-abce-0e52bcedde8c", "name": "network-vif-deleted", "tag": "a135ff9a-d835-4ae7-aac4-370fd7ef3349"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:58:25.365119 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:25.365593 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:25.366017 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:25.378416 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] Creating event network-vif-deleted:a135ff9a-d835-4ae7-aac4-370fd7ef3349 for instance 00f5039f-726c-4c4b-abce-0e52bcedde8c on hv-cinder-85827 Sep 19 10:58:25.383354 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-4c753988-e382-4fbc-a768-a008d04fce60 req-edca4e78-a522-43b2-aefb-d4d5bf0f85c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034787 Sep 19 10:58:25.383941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 623/1226] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:58:25.384782 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:25.385476 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:25.392468 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:25.393249 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:25.393728 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:25.394427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:25.394880 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:25.395393 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:25.458291 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:25.466071 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d18ad15b-c427-4ab1-8d51-cab5ad94164e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1389 microversion: 2.1 time: 0.085867 Sep 19 10:58:25.466647 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 604/1227] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:25 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 10:58:26.490436 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:26.491142 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:26.497261 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:26.497742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:26.498177 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:26.498862 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:26.499317 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:26.499744 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:26.529752 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:26.530224 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:26.530657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:26.531098 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lazy-loading 'fault' on Instance uuid 00f5039f-726c-4c4b-abce-0e52bcedde8c {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:58:26.571124 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:26.578742 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-bb6a79f5-734d-4082-92a3-f2b4cd938389 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 200 len: 1229 microversion: 2.1 time: 0.092917 Sep 19 10:58:26.579302 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 624/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:26 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:27.601554 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:27.602093 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: 00f5039f-726c-4c4b-abce-0e52bcedde8c] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:27.608984 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:27.609504 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:27.609942 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:27.610637 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:27.611092 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:27.611523 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:27.625179 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] HTTP exception thrown: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Request method failure captured: Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c HTTP/1.1 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEmzYPjjo_RNu1p3221xbC3XVqM0r5TtidGBWParcajP8VPzghI3_uDEkV-QelWY2PTqW4gQjwivdPEs8uM2FfIgMoYmdcqJUfBzky6Yc0CjAZNkebOB9qLfTy3s1h8jrPU8YYLrbTPaao4ifHDDThZRGJP3XH2WU7_vA3IXh-ldrgA Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:58:27.626805 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83720c34e40e4f2ba7f9fe719db3c259", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}] Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 78b9e41066d04492bed776a5c013346f Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. Sep 19 10:58:27.628635 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': '00f5039f-726c-4c4b-abce-0e52bcedde8c'} Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:58:27.629691 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. Sep 19 10:58:27.631431 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:27.632961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Returning 404 to user: Instance 00f5039f-726c-4c4b-abce-0e52bcedde8c could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:58:27.632961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-d0f0a8da-0367-4465-aa06-e5401c839806 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c" status: 404 len: 111 microversion: 2.1 time: 0.030703 Sep 19 10:58:27.632961 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 605/1229] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:27 2022] GET /compute/v2.1/servers/00f5039f-726c-4c4b-abce-0e52bcedde8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 10:58:30.961664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:30.962186 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:30.963902 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7", "tag": "cf274c7b-27ae-46d6-b4dc-5abaf2eb041e"}]} {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:58:30.968646 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:30.969389 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:30.969835 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:30.970537 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:30.971214 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:30.971647 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:30.974285 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:30.975051 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:30.975561 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:30.987672 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.compute.server_external_events [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] Creating event network-changed:cf274c7b-27ae-46d6-b4dc-5abaf2eb041e for instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 on hv-cinder-85827 Sep 19 10:58:30.993135 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [req-d21a88ce-0814-4fca-8cbe-cf114d10f9fa req-c94f0596-23c4-424f-9c29-1617b26d4b1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Sep 19 10:58:30.994139 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 606/1230] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 10:58:30.999866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Going to try to terminate instance {{(pid=127496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 10:58:31.286369 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-1207b4c7-dc5d-49ea-a1ce-29e65a1d0484 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 204 len: 0 microversion: 2.1 time: 0.328192 Sep 19 10:58:31.287519 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 625/1231] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:58:30 2022] DELETE /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 10:58:31.296158 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:31.297159 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:31.303515 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:31.304265 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:31.304927 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:31.305657 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:31.306293 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:31.306737 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:31.439560 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:31.447366 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-bf96b2a0-7c4d-4a85-9440-f2aae2de3f9e tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1576 microversion: 2.1 time: 0.155365 Sep 19 10:58:31.447939 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 607/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:31 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:32.471664 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:32.472366 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:32.478812 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:32.479290 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:32.479730 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:32.480415 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:32.480866 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:32.481315 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:32.607521 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:32.615115 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-3ca04309-561d-44c8-a95e-6fed3ac73a26 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1576 microversion: 2.1 time: 0.147678 Sep 19 10:58:32.615679 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 626/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:32 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:33.639652 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:33.640220 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:33.646833 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:33.647308 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:33.647736 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:33.648420 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:33.648876 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:33.649414 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:34.095373 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7", "name": "network-vif-deleted", "tag": "cf274c7b-27ae-46d6-b4dc-5abaf2eb041e"}]} {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 10:58:34.104657 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:34.108231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:34.108231 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:34.118155 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.policy [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127497) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:34.119676 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.compute.server_external_events [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] Creating event network-vif-deleted:cf274c7b-27ae-46d6-b4dc-5abaf2eb041e for instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 on hv-cinder-85827 Sep 19 10:58:34.125460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [req-2e2e1459-d636-4372-8f7d-8eb4d71ac19a req-99841b95-b4b1-48b5-91a5-084fed41fa51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034303 Sep 19 10:58:34.126047 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 627/1234] 10.222.0.42 () {64 vars in 1317 bytes} [Mon Sep 19 10:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 10:58:34.127289 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-972cd506-c819-4941-a6bb-9ae39b9ee268 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1458 microversion: 2.1 time: 0.492268 Sep 19 10:58:34.127857 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 608/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:33 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1458 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:35.151941 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:35.152642 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:35.159404 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:35.160020 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:35.160460 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:35.161226 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:35.161685 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:35.162112 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:35.193159 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:35.193559 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:35.193996 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:35.194441 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.objects.instance [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lazy-loading 'fault' on Instance uuid b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 {{(pid=127496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 10:58:35.238287 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.policy [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78b9e41066d04492bed776a5c013346f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83720c34e40e4f2ba7f9fe719db3c259', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 10:58:35.246707 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-41aa259d-0b42-4825-b7ff-a52dbb2be322 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 200 len: 1230 microversion: 2.1 time: 0.098975 Sep 19 10:58:35.247267 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 628/1236] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:35 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 10:58:36.271233 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:36.272049 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:36.278789 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.279269 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.279703 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.280393 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.280838 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.281299 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.295506 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] HTTP exception thrown: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Request method failure captured: Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 HTTP/1.1 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEmzYPjjo_RNu1p3221xbC3XVqM0r5TtidGBWParcajP8VPzghI3_uDEkV-QelWY2PTqW4gQjwivdPEs8uM2FfIgMoYmdcqJUfBzky6Yc0CjAZNkebOB9qLfTy3s1h8jrPU8YYLrbTPaao4ifHDDThZRGJP3XH2WU7_vA3IXh-ldrgA Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:58:36.297600 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83720c34e40e4f2ba7f9fe719db3c259", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}] Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 78b9e41066d04492bed776a5c013346f Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. Sep 19 10:58:36.299406 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7'} Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:58:36.300432 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. Sep 19 10:58:36.302242 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.303772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Returning 404 to user: Instance b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:58:36.303772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-0f16f72a-c560-4fd6-bb4e-d39ec22da50f tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7" status: 404 len: 111 microversion: 2.1 time: 0.032476 Sep 19 10:58:36.303772 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 609/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:36 2022] GET /compute/v2.1/servers/b278e2bb-fb8e-4deb-a8c1-a18d2a3244d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:58:36.820716 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:36.821284 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.compute.api [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:36.827704 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.828190 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.828631 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.829356 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.829818 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.830243 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG oslo_concurrency.lockutils [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.843140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.wsgi [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] HTTP exception thrown: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Request method failure captured: Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: request: DELETE /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba HTTP/1.1 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept: application/json Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Accept-Encoding: identity Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Connection: close Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Length: 0 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Content-Type: application/json Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Host: 10.222.0.42 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: Openstack-System-Scope: None Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: User-Agent: python-urllib3/1.26.12 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Auth-Token: gAAAAABjKEmzYPjjo_RNu1p3221xbC3XVqM0r5TtidGBWParcajP8VPzghI3_uDEkV-QelWY2PTqW4gQjwivdPEs8uM2FfIgMoYmdcqJUfBzky6Yc0CjAZNkebOB9qLfTy3s1h8jrPU8YYLrbTPaao4ifHDDThZRGJP3XH2WU7_vA3IXh-ldrgA Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Id: None Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Domain-Name: None Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Identity-Status: Confirmed Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Is-Admin-Project: True Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Id: default Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Domain-Name: Default Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Project-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Role: member,reader Sep 19 10:58:36.844778 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Roles: member,reader Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83720c34e40e4f2ba7f9fe719db3c259", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}] Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Id: default Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Domain-Name: Default Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Id: 78b9e41066d04492bed776a5c013346f Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: X-User-Name: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: method: > Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: exception: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.846533 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: action_args: {'id': 'df4ae582-5ab5-4a47-8929-5bbae1ac2fba'} Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:58:36.847532 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.849164 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.850966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Returning 404 to user: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. {{(pid=127496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:58:36.850966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-9a989bb9-ffcd-4044-b478-4829283ff2ae tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 404 len: 111 microversion: 2.1 time: 0.029465 Sep 19 10:58:36.850966 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 629/1238] 10.222.0.42 () {58 vars in 1239 bytes} [Mon Sep 19 10:58:36 2022] DELETE /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:58:36.855402 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '>' {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:36.856017 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.compute.api [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] [instance: df4ae582-5ab5-4a47-8929-5bbae1ac2fba] Fetching instance by UUID {{(pid=127497) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 10:58:36.861950 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.862427 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.862891 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.863579 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Acquiring lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 10:58:36.864032 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 10:58:36.864457 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG oslo_concurrency.lockutils [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Lock "8eb960d1-8620-481b-b5ca-3620f2dadac9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127497) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 10:58:36.877705 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.wsgi [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] HTTP exception thrown: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Request method failure captured: Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: request: GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba HTTP/1.1 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept: application/json Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Accept-Encoding: identity Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Connection: close Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Length: 0 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Content-Type: application/json Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Host: 10.222.0.42 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: Openstack-System-Scope: None Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: User-Agent: python-urllib3/1.26.12 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Auth-Token: gAAAAABjKEmzYPjjo_RNu1p3221xbC3XVqM0r5TtidGBWParcajP8VPzghI3_uDEkV-QelWY2PTqW4gQjwivdPEs8uM2FfIgMoYmdcqJUfBzky6Yc0CjAZNkebOB9qLfTy3s1h8jrPU8YYLrbTPaao4ifHDDThZRGJP3XH2WU7_vA3IXh-ldrgA Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Id: None Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Domain-Name: None Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Identity-Status: Confirmed Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Is-Admin-Project: True Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Id: default Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Domain-Name: Default Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Project-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Role: member,reader Sep 19 10:58:36.879202 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Roles: member,reader Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_83720c34e40e4f2ba7f9fe719db3c259", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/83720c34e40e4f2ba7f9fe719db3c259"}]}] Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Id: 83720c34e40e4f2ba7f9fe719db3c259 Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826540791 Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Id: default Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Domain-Name: Default Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Id: 78b9e41066d04492bed776a5c013346f Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: X-User-Name: tempest-TestVolumeBootPattern-1826540791-project Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: method: > Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: exception: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.880889 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: action_args: {'id': 'df4ae582-5ab5-4a47-8929-5bbae1ac2fba'} Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: {{(pid=127497) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 10:58:36.881794 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. Sep 19 10:58:36.883358 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: ERROR nova.api.openstack.wsgi Sep 19 10:58:36.884766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: DEBUG nova.api.openstack.wsgi [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Returning 404 to user: Instance df4ae582-5ab5-4a47-8929-5bbae1ac2fba could not be found. {{(pid=127497) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 10:58:36.884766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: INFO nova.api.openstack.requestlog [None req-fea629c7-318f-4b66-881f-93d666ac586c tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba" status: 404 len: 111 microversion: 2.1 time: 0.029557 Sep 19 10:58:36.884766 dv-cinder-858275-1-iscsi devstack@n-api.service[127497]: [pid: 127497|app: 0|req: 610/1239] 10.222.0.42 () {58 vars in 1236 bytes} [Mon Sep 19 10:58:36 2022] GET /compute/v2.1/servers/df4ae582-5ab5-4a47-8929-5bbae1ac2fba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 10:58:38.343140 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: DEBUG nova.api.openstack.wsgi [None req-ede97c00-c227-43c2-82c7-f93e2216ad74 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] Calling method '.version_select at 0x7fb9431d4670>' {{(pid=127496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 10:58:38.431313 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: INFO nova.api.openstack.requestlog [None req-ede97c00-c227-43c2-82c7-f93e2216ad74 tempest-TestVolumeBootPattern-1826540791 tempest-TestVolumeBootPattern-1826540791-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-309489895" status: 202 len: 0 microversion: 2.1 time: 0.092093 Sep 19 10:58:38.431896 dv-cinder-858275-1-iscsi devstack@n-api.service[127496]: [pid: 127496|app: 0|req: 630/1240] 10.222.0.42 () {58 vars in 1260 bytes} [Mon Sep 19 10:58:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-309489895 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)